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1. Introduction 

It has been almost 20 years since two of us proposed a rather speculative approach 
to the problem of restriction of irreducible representations from S0„ to SO„_i [GPl, 
GP2]. Our predictions depended on the Langlands parameterization of irreducible 
representations, using L-packets and L-parameters. Since then, there has been con- 
siderable progress in the construction of local L-packets, as well as on both local and 
global aspects of the restriction problem. We thought it was a good time to review the 
precise conjectures which remain open, and to present them in a more general form, 
involving restriction problems for all of the classical groups. 

Let A; be a local field equipped with an involution a with fixed field k^. Let \^ be a 
vector space over k with a non-degenerate sesquilinear form and let G(y) be the identity 
component of the classical subgroup of GL(l^) over /cq which preserves this form. There 
are four distinct cases, depending on whether the space V is orthogonal, symplectic, 
hermitian, or skew-hermitian. In each case, for certain non-degenerate subspaces W of 
y, we define a subgroup H of the locally compact group G = G{V) x G(W) containing 
the diagonally embedded subgroup G(W), and a unitary representation z/ of H. The 
local restriction problem is to determine 

d^n) = dime IIomj7(7r (g) 17, C), 

where tt is an irreducible complex representation of G. 

The basic cases are when dim V^— dim = 1 or 0, where u is the trivial representation 
or a Weil representation respectively. When dim\^ — dimPF > 2, this restriction 
problem is also known as the existence and uniqueness of Bessel or Fourier- Jacobi 
models in the literature. As in [GPl] and [GP2], our predictions involve the Langlands 
parameterization, in a form suggested by Vogan [Vo], and the signs of symplectic root 
numbers. 

We show that the Langlands parameters for irreducible representations of classical 
groups (and for genuine representations of the metaplectic group) are complex rep- 
resentations of the Weil-Deligne group of k, of specified dimension and with certain 
duality properties. We describe these parameters and their centralizers in detail, before 
using their symplectic root numbers to construct certain distinguished characters of the 
component group. Our local conjecture states that there is a unique representation vr 
in each generic Vogan L-packet, such that the dimension din) is equal to 1. Further- 
more, this representation corresponds to a distinguished character x of the component 
group. For all other representations vr in the L-packet, we predict that d{7i) is equal 
to 0. The precise statements are contained in Conj ectures 117.11 and 117.31 

Although this material is largely conjectural, we prove a number of new results in 
number theory and representation theory along the way: 
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(i) In Proposition I5.2[ we give a generalization of a formula of Deligne on orthogonal 
root numbers to the root numbers of conjugate orthogonal representations. 

(ii) We describe the L-parameters of classical groups, and unitary groups in particular, 
in a much simpler way than currently exists in the literature; this is contained in 
Theorem I8.1[ 

(iii) We show in Theorem 111.11 that the irreducible representations of the metaplectic 
group can be classified in terms of the irreducible representations of odd special 
orthogonal groups; this largely follows from fundamental results of Kudla-Rallis 
[KR], though the statement of the theorem did not appear explicitly in [KR]. 

(iv) We prove two theorems (cf. Theorems 115.11 and 116. ip that allow us to show the 
uniqueness of general Bessel and Fourier- Jacobi models over non-archimedean 
local fields. More precisely, we show that d{Tr) < 1 in almost all cases (cf. Corol- 
laries [T5?2l 116.21 and 116.31) . reducing this to the basic cases when dimiy^ = or 
1, which were recently established by [AGRS] and [S]. The same theorems allow 
us to reduce our local conjectures to these basic shown in Theorem 119. II 

One subtle point about our local conjecture is its apparent dependence on the choice 
of an additive character of or k/ko. Indeed, the choice of such a character ip is 
potentially used in 3 places: 

(a) the Langlands-Vogan parametrization (which depends on fixing a quasi-split pure 
inner form Gq of G, a Borel subgroup Bq of Gq, and a non-degenerate character on 
the unipotent radical of Bq); 

(b) the definition of the distinguished character x of the component group; 

(c) the representation z/ of if in the restriction problem. 

Typically, two of the above depend on the choice of ip, whereas the third one doesn't. 
More precisely, we have: 

- in the orthogonal case, none of (a), (b) or (c) above depends on ip; this explains why 
this subtlety does not occur in [GPl] and [GP2]. 

- in the hermitian case, (a) and (b) depend on the choice of ip : k/k^ S^, but (c) 
doesn't. 

- in the symplectic /metaplectic ) and (c) depend on ip '■ kQ ^ S^, but (b) 
doesn't. 

- in the odd skew-hermit ian case, (b) and (c) depend on ip : ko —>■ S^, but (a) doesn't. 

- in the even skew-hermit ian ) and (c) depend on ip : ko but (b) doesn't. 



Given this, we check in ^TEl that the dependence on ip cancels out in each case, so 
that our local conjecture is internally consistent with respect to changing ip. There is. 
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however, a variant of our local conjectures which is less sensitive to the choice of ijj, 
but is slightly weaker. This variant is given in Conjecture I20.1[ Finally, when all the 
data involved are unramified, we state a more refined conjecture; this is contained in 
Conjecture 121.31 

After these local considerations, we study the global restriction problem, for cuspi- 
dal tempered representations of adelic groups. Here our predictions involve the central 
values of automorphic L-functions, associated to a distinguished symplectic represen- 
tation R of the L-group. More precisely, let G = G(y) x G(W) and assume that n is 
an irreducible cuspidal representation of G{A), where A is the ring of adeles of a global 
field F. If the vector space }iomH(A){''^ ® z^,C) is nonzero, our local conjecture implies 
that the global root number e(7r, -R, |) is equal to 1. If we assume tt to be tempered, 
then our calculation of global root numbers and the general conjectures of Langlands 
and Arthur predict that vr appears with multiplicity one in the discrete spectrum of 
L'^{G{F)\G{A)). We conjecture that the period integrals on the corresponding space 
of functions 



gives a nonzero element in Homi^(A) (vr u, C) if and only if the central critical L- value 
L{tt, R, |) is nonzero. 

This first form of our global conjecture is given in after which we examine the 
global restriction problem in the framework of Langlands-Arthur's conjecture on the 
automorphic discrete spectrum, and formulate a more refined global conjecture in ^ }26l 
For this purpose, we formulate an extension of Langlands' multiplicity formula for 
metaplectic groups; see Conjecture 125.11 

One case in which all of these conjectures are known to be true is when k = koxko is 
the split quadratic etale algebra over kQ, and \^ is a hermitian space over k of dimension 
n containing a codimension one nondegenerate subspace W. Then 



Moreover, u is the trivial representation. When k^ is local, and vr is a generic repre- 
sentation of G = GL„(fco) X GL„_i(fco), the local theory of Rankin- Selberg integrals 
[JPSS], together with the multiplicity one theorems of [AGRS], [AG] and [SZ], shows 
that 



This agrees with our local conjecture, as the Vogan packets for G = GL„(fco) x 
GL„_i(/co) are singletons. If ko is global and vr is a cuspidal representation of G(A), 
then TT appears with multiplicity one in the discrete spectrum. The global theory of 
Rankin- Selberg integrals [JPSS] implies that the period integrals over H{k)\H{A) give 
a nonzero linear form on vr if and only if 




G = GK{ko) X GL„_i(A;o) and H ^ GL„_i(fco). 



dim HomH(7r, C) = 1. 



L(7r, std„ (g) stdn_i, 1/2) 7^ 0, 
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where L(7r, std„ ® std^-i, s) denotes the tensor product L-function. Again, this agrees 
with our global conjecture, since in this case, the local and global root numbers are all 
equal to 1, and 

R = std„ ® std„_i + std^ ® std^_]^. 

In certain cases where the global root number e = —1, so that the central value is 
zero, we also make a prediction for the first derivative in ^Q7\ The cases we treat are 
certain orthogonal and hermitian cases, with dimly-*- = 1. We do not know if there 
is an analogous conjecture for the first derivative in the symplectic or skew-hermitian 
cases. 

In a sequel to this paper, we will present some evidence for our conjectures, for 
groups of small rank and for certain discrete L-packets where one can calculate the 
distinguished character explicitly. 

Acknowledgments: W. T. Gan is partially supported by NSF grant DMS-0801071. 
B. H. Gross is partially supported by NSF grant DMS 0901102. D. Prasad was partially 
supported by a Clay Math Institute fellowship during the course of this work. We also 
thank P. Deligne, S. Kudla, M. Reeder, D. Rohrlich, and J.-L. Waldspurger for their 
help. 

2. Classical groups and restriction of representations 

Let k he a. field, not of characteristic 2. Let a be an involution of k having ko as the 
fixed field. If a = 1, then ko = k. If cr 7^ 1, is a quadratic extension of ko and a is 
the nontrivial element in the Galois group Gal(A;/A;o). 

Let \^ be a finite dimensional vector space over k. Let 

{,):V xV ^k 

be a non-degenerate, a-sesquilinear form on V, which is e-symmetric (for e = ±1 in 



{av + Pw,u) = a{v,u) + l3{w,u) 
{u, v) = e ■ (t>, m)'^. 

Let G(y) C GL{V) be the algebraic subgroup of elements T in GL(y) which preserve 
the form (, ): 

{Tv, Tw) = {v, w). 

Then G(y) is a classical group, defined over the field ko- The different possibilities for 
G(y) are given in the following table. 
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{k,e) 


k — ko, e — 1 


k — ko, e — —1 


k/ko quadratic, e — ±1 


G{V) 


orthogonal group 0{V) 


symplectic group Sp(l^) 


unitary group U{V) 



In our formulation, a classical group will always be associated to a space V, so the 
hermitian and skew-hermitian cases are distinct. Moreover, the group G{V) is con- 
nected except in the orthogonal case. In that case, we let SO(K) denote the connected 
component, which consists of elements T of determinant +1, and shall refer to SO(V) 
as a connected classical group. We will only work with connected classical groups in 
this paper. 

If one takes k to be the quadratic algebra ko x ko with involution a{x, y) = {y, x) and 

V a free /c-module, then a non-degenerate form (, ) identifies the k — ko x ko module 

V with the sum Vq + Vq , where Vq is a finite dimensional vector space over ko and V^"^ 
is its dual. In this case G{V) is isomorphic to the general linear group GL(Vo) over ko- 

If G is a connected, reductive group over ko, the pure inner forms of G are the 
groups G' over ko which are obtained by inner twisting by elements in the pointed set 
H^{ko, G). If {Qfj} is a one cocycle on the Galois group of the separable closure k^ with 
values in G{kf^, the corresponding pure inner form G' has points 

G\ko) = {aeG{k^^):a'^ = g^ag-'}. 

The group G' is well-defined up to inner automorphism over ko by the cohomology 
class of g„, so one can speak of a representation of G'{ko). 

For connected, classical groups G{y) C GL(V), the pointed set H^{ko,G) and the 
pure inner forms G' correspond bijectively to forms V of the space V with its sesquilin- 
ear form (, ) (cf. [KMRT, §29D and §29E]). 

Lemma 2.1. (1) IfG = GL{V) orG^ Sp(y), then the pointed set H\ko, G) = 1 

and there are no nontrivial pure inner forms ofG. 

(2) If G = U(V^), then elements of the pointed set H^{ko, G) correspond bijectively 
to the isomorphism classes of hermitian (or skew-hermitian) spaces V over k 
with dim(y) = dim(y). The corresponding pure inner form G' of G is the 
unitary group \]{y'). 

(3) If G = SO{V), then elements of the pointed set H^{ko, G) correspond bijectively 
to the isomorphism classes of orthogonal spaces V over k with dim(V^') = 
dim(F) and disc (l^') = disc(l^). The corresponding pure inner form G' of G is 
the special orthogonal group SO{V'). 



RESTRICTION PROBLEMS FOR CLASSICAL GROUPS 



7 



Now let 1^ C y be a subspace, which is non-degenerate for the form (, ). Then 
V + W-^. We assume that 

1) e- (-l)d™^^ = -1 

2) W-^ is a spht space. 

When e = — 1, so dim W-^ — 2n is even, condition 2) means that W-^ contains an 
isotropic subspace X of dimension n. It follows that W-^ is a direct sum 

W^^X + Y, 

with X and Y isotropic. The pairing (— , — ) induces a natural map 

Y — ^Homfc(X, k) ^X^ 

which is a /co-linear isomorphism (and /c-anti-linear ii k ^ ko). When e = +1, so dim 
W-^ = 2n + 1 is odd, condition 2) means that W-^ contains an isotropic subspace X of 
dimension n. It follows that 

= X + Y + E, 

where E is a non-isotropic line orthogonal to X + Y, and X and Y are isotropic. As 
above, one has a fco-linear isomorphism Y = X^ . 

Let G(W) be the subgroup of G{V) which acts trivially on W-^. This is the classical 
group, of the same type, associated to the space W. Choose an X c W-^ as above, and 
let P be the parabolic subgroup of G{V) which stabihzes a complete flag of (isotropic) 
subspaces in X. Then G{W), which acts trivially on both X and X^, is contained in 
a Levi subgroup of P, and acts by conjugation on the unipotent radical N of P. 

The semi-direct product H = N xi G{W) embeds as a subgroup of the product group 
G = G{V)xG{W) as follows. We use the defining inclusion H (Z P C GiV) on the first 
factor, and the projection H H/N — G{W) on the second factor. When e — +1, 
the dimension of H is equal to the dimension of the complete flag variety of G. When 
e = — 1, the dimension of H is equal to the sum of the dimension of the complete flag 
variety of G and half of the dimension of the vector space W over ko. 

Wc call a pure inner form G' = G{V') x G(W') of the group G relevant if the space W 
embeds as a non- degenerate subspace of V, with orthogonal complement isomorphic 
to W-^. Then a subgroup H' G' can be deflned as above. 

In this paper, we will study the restriction of irreducible complex representations of 
the groups G' — G{V') x G{W') to the subgroups H', when A; is a local or a global 
held. 

3. Selfdual and conjugate-dual representations 

Let k he a local fleld, and let k^ be a separable closure of k. In this section, we will 
deflne selfdual and conjugate-dual representations of the Weil-Deligne group WD of k. 
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When /c = M or C, we define WD as the Weil group W{k) of k, which is an extension 
of Gal(A;*/A;) by C^, and has abehanization isomorphic to A;^. A representation of WD 
is, by definition, a completely reducible (or semisimple) continuous homomorphism 

ip : WD GL(M), 

where M is a finite dimensional complex vector space. When k is non-archimedean, 
the Weil group W{k) is the dense subgroup I x oi Gal{k^/k), where / is the inertia 
group and F is a geometric Probenius. We normalize the isomorphism 

W{k)'''' k"" 

of local class field theory as in Deligne [D], taking F to a uniformizing element of /c^. 
This defines the norm character 

|-|:W^(^)^M^ with|F| = g-^ 

We define WD as the product of W{k) with the group SL2(C). A representation is a 
homomorphism 

: WD GL(M) 

with 

(i) (f trivial on an open subgroup of /, 

(ii) (p{F) semi-simple, 

(iii) ip : SL2(C) ^ GL(M) algebraic. 

The equivalence of this formulation of representations with that of Dclignc [D] , in which 
a representation is a homomorphism p : W{k) — > GL(M) and a nilpotcnt cndomor- 
phism iV of M which satisfies Adp{w){N) = \w\ ■ N, is given in [GR, §2, Proposition 
2.2] 

We say two representations M and M' of WD arc isomorphic if there is a linear 
isomorphism f : M ^ M' which commutes with the action of WD. If M and M' 
are two representations of WD, we have the direct sum representation M ® M' and 
the tensor product representation M ® M' . The dual representation Af^ is defined 
by the natural action on Hom(M, C), and the determinant representation dct(M) is 
defined by the action on the top exterior power. Since GLi(C) = is abelian, the 
representation det(M) factors through the quotient W{kY^ — > k^ of WD. 

We now define certain selfdual representations of WD. We say the representation 
M is orthogonal if there is a non-degenerate bilinear form 

B:MxM 

which satisfies 

B{Tm, TTi) — B{m, n) 
B{n, m) — B{m, n), 
for all T in WD. 
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We say M is symplectic if there is a non-degenerate bilinear form B on M which 
satisfies 

B{Tm, to) = B{n, n) 
B{n,m) — —B{m.,n), 
for all T in WD. 

In both cases, the form B gives an isomorphism of representations 

f -.M ^ M^, 

whose dual 

: M = M^^ ^ 

satisfies 

^b-f, with b = the sign of B. 

We now note: 

Lemma 3.1. Given any two non- degenerate forms B and B' on M preserved by WD 
with the same sign b — ±1, there is an automorphism T of M which commutes with 
WD and such that B'{m,n) = B{Tm,Tn). 

Proof. Since M is semisimple as a representation of WD, we may write 

i 

as a direct sum of irreducible representations with multiplicity spaces V^. Each Mj is 
either self dual or else My = Mj for some i ^ j, in which case dim\^ = dim V^-. So we 
may write 

M= (^^V.^M^j © (p. + /^v) j 

with Mi irreducible selfdual and Pj irreducible but Pj ^ py . Since any non-dcgcncrate 
form B remains non-degcncratc on each summand above, we arc reduced to the cases: 

(a) M = V ® N with N irreducible and selfdual, in which case the centralizer of 
the action of WD is GL{V); 

(b) M = {V 0P)®{V P"^), with P irreducible and P ^ P^, in which case the 
centralizer of the action of WD is GL{V) x GL{V). 

In case (a), since N is irreducible and selfdual, there is a unique (up to scaling) 
PFD-invariant non- degenerate bilinear form on N; such a form on N has some sign 
Bn. Thus, giving a W^D-invariant non-degenerate bilinear form P on M of sign b is 
equivalent to giving a non-degenerate bilinear form on V of sign b -b^- But it is well- 
known that any two non-degenerate bilinear forms of a given sign are conjugate under 
Ghiy). This takes care of (a). 
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In case (b), the subspaces V <^ P and V ® -P^ are necessarily totally isotropic. 
Moreover, there is a unique (up to scaling) VF£)-invariant pairing on P x P^. Thus 
to give a l^D-invariant non-degenerate bilinear form 5 on M of sign b is equivalent 
to giving a non-degenerate bilinear form on V. But any two such forms are conjugate 
under the action of GL(V) x GL(y) on V x V. This takes care of (b) and the lemma 
is proved. □ 

When M is symplectic, dim(M) is even and det(M) = 1. When M is orthogo- 
nal, dct(Af) is an orthogonal representation of dimension 1. These representations 
correspond to the quadratic characters 

X:A;X^(±1). 

Since cheir{k) ^ 2, the Hilbert symbol gives a perfect pairing 

(-,-) :A;VA;X'xA;7A;X2^(±l). 

Wc let C{d) be the one dimensional orthogonal representation given by the character 
Xd{c) = {c,d). 

We also note the following elementary result: 

Lemma 3.2. // Mj is selfdual with sign bi, for i = 1 or 2, then Mi ® M2 is selfdual 
with sign 61 • 62- 

Proof. If Mj is selfdual with respect to a form of sign 6j, then Mi ® M2 is selfdual 
with respect to the tensor product Bi (g) B2 which has sign 61 • 62- D 

Next, assume that a is a nontrivial involution of k, with fixed field ko. Let s be an 
element of WD{ko) which generates the quotient group 

WD(ko)/WD{k) = Gal(A;/A;o) = (1,(7). 

If M is a representation of WD, let M^ denote the conjugate representation, with the 
same action of SL2(C) and the action Ts{m) — STS~^{m) for r in W{k). 

We say the representation M is conjugate-orthogonal if there is a non-degenerate 
bilinear form P : M x M — > C which satisfies 

P(Tm, STS~^n) — B{m, n) 
B{n, m) — B{m, s^n), 

for all r in WD. We say M is conjugate-symplectic if there is a non-degenerate bilinear 
form on M which satisfies 

P(Tm, STS~^n) — B{m, n) 
B{n,m) — —B{m, s'^n), 
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for all r in WD. In both cases, the form B gives an isomorphism of representations 
whose conjugate-dual 

(/v)s . ^ ((M^)V)- M 

satisfies 

(f^y = b- f with b = the sign of B. 

We now note: 

Lemma 3.3. Given two such non-degenerate forms B and B' on M with the same 
sign and preserved by WD, there is an automorphism of M which commutes with WD 
and such that B'{m,n) = B{Tm,Tn) . 

Proof. The proof is similar to that of Lemma 13. 1[ As before, we may reduce to the 
following two cases: 

(a) M = V^N with irreducible and conjugate-dual, in which case the centralizer 
of the action of WD is GL{V)] 

(b) M = (y ® P) ® {V IS) (P'y) with P irreducible and P ^ {P'^ , in which case 
the centralizer of the action of WD is GL(V') x GL{V). 

In case (a), if the conjugate-duality of has sign b^, then giving a Pi^D-invariant 
non-degenerate bilinear form on M of sign b is equivalent to giving a non-degenerate 
bilinear form on V of sign b ■ b^, and all such are conjugate under GL(\^). Similarly, 
in case (b), giving a W D-invahant non-degenerate bilinear form on M of sign b is 
equivalent to giving a non-degenerate bilinear form on V, and all such are conjugate 
under GL(V) x GL{V). □ 

The isomorphism class of the representation is independent of the choice of s in 
WD{ko) — WD. If s' = ts is another choice, then the map 

f : M' ^ M'' 
m t{m) 

is an isomorphism of representations of WD. We denote the isomorphism class of M'^ 
and simply by M'^ . If M is conjugate-orthogonal or conjugate-symplectic by the 
pairing B relative to s, then it is conjugate-orthogonal or conjugate-symplectic by the 
pairing 

B'{m, f{n)) = B{m, n) 
relative to s' . In both cases, M°" is isomorphic to the dual representation M^. 

If M is conjugate-dual via a pairing B with sign 6 = ±1, then det(M) is conjugate- 
dual with sign = Any conjugate-dual representation of WD of dimension 
1 gives a character % : /c^ — which satisfies x^'^'^ = 1. Hence x is trivial on the 
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subgroup Nk^ , which has index 2 in /cq . We denote this 1-dimensional representation 
byC(x). 

Lemma 3.4. The representation C(x) is conjugate-orthogonal if and only ifx is trivial 
on /cq 7 o,'>T'd conjugate-symplectic if and only ifx is nontrivial on but trivial on Nk^ . 

Proof. : Since the action of WD on C(x) factors through the quotient W{k)"''^, we may 
compute with the quotient W{k/ko) of W{ko). The Weil group W{k/ko) is isomorphic 
to the normahzer of A;^ in the multiphcativc group of the quaternion division algebra 
over kf) [Wei, Appendix 111, Theorem 2]. It is therefore generated by and s, with 
sa = for a E k^ , and in k^ generating the quotient k^ /Nk^. 

If xis"^) = +1) then the form B{z,w) — zw on C(x) is conjugate-orthogonal. If 
x(s^) = —1, then this form is conjugate-symplectic. □ 



We also note: 

Lemma 3.5. (i) If M is conjugate-dual with sign h, then N — Ind|^^|^°'*M is self dual 
with sign b. 

(a) If Mi is conjugate- dual with sign bi, for i = lor2, then Mi ®M2 is conjugate- dual 
with sign 6i • 62- 



Proof. For (i), suppose that M is conjugate- dual with respect to a form B. As a vector 
space, N = M©s~^-M for s G WD{kQ) \ WD{k). We define a non-degenerate bilinear 
form Bn on N by decreeing that M and s^^ ■ M are isotropic spaces and setting 

BN{m, ■ m') = B{m, m'), 
Bn{s~^ ■ m', m) = b ■ B]y{m, ■ m'). 

It is easy to check that B]^ is preserved by WDifvo); this proves (i). The assertion (ii) 
is also straightforward: if Mj is conjugate- dual with respect to the form B^ of sign fej, 
then Ml ® M2 is conjugate-dual with respect to the tensor product Bi ® B2 which has 
sign 61 • 62- n 



Remark: M. Weissman has pointed out that the representation M'^ can be more 
canonically defined (without resorting to the choice of s e WD{k) \ WD{kQ)) in the 
following way. Consider the induced representation Ind|j|^^|i^°^M which can be realized 
on: 

{/ : WD(ko) ^ M : f(T ■ s) ^ r(f(s)) for all r e WD(k) and s e WD(ko)}. 

Then the representation of WD(k) can be realized on the subspace of such functions 
which are supported on WD{ko) \ WD{k). We note: 
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(i) Any H^D-equivariant map M ^ N induces a natural VTD-equivariant map M'^ 
N". 

(ii) There is a natural isomorphism (iW^)^ (M^)*^, via the perfect duahty on 
M" X (M^)^ defined by 

(/, n ^ ifis), f'is)), for feM'^ and f e 

for any s e WD{ko) \ WD{k) and where (— , — ) denotes the natural pairing on 
M X M^. The above pairing is clearly independent of the choice of s. 

(iii) On this model of M"^, there is a canonical isomorphism 

{M^y — ^ M 

given by 

for any s e WD{kQ) \ 1^D(A;). This isomorphism is independent of the choice of 
s. 

Thus a conjugate-duality with sign 6 is a VF£)-equivariant isomorphism 

/ : ^ 

whose conjugate-dual 
satisfies 

This treatment allows one to suppress the somewhat mysterious looking identity B{n, m) = 
b ■ B{m, s^n). 

4. The centralizer and its group of components 

The centralizer C{M) of a representation M of WD is the subgroup of GL(M) which 
centrahzes the image. Write 

as a direct sum of irreducible representations Mj, with multiplicities mj > 1. Then by 
Schur's lemma 

C(M) ~ JjGL(mi,C). 
In particular, C ( M ) is a connected reductive group. 

The situation is more interesting for representations M which are either selfdual 
or conjugate-dual, via a pairing B with sign h = ±1. We define C = C{M,B) as 
the subgroup of Aut(M, B) C GL(M) which centralizes the image of WD. Up to 
isomorphism, the reductive group C depends only on the representation M. 
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If we write M as a direct sum of irreducible representations Mj, with multiplicities 
rrii, and consider their images in under the isomorphism ikf^ —>■ provided by 
B, we find that there are three possibilities: 

(1) Mf is isomorphic to , via a pairing Bi of the same sign b as B. 

(2) M°" is isomorphic to , via pairing B^ of the opposite sign —ba.sB. In this 
case the multiplicity is even. 

(3) Mf is isomorphic to Mj^, with j ^ i. In this case mi = rrij. 

Hence, we have a decomposition 

where the Mj are self dual or conjugate-dual of the same sign b, the Ni are selfdual or 
conjugate-dual of the opposite sign —b, and P" is not isomorphic to P/, so that Pi and 
Pj = {PiY are distinct irreducible summands. 

In this case, the proofs of Lemmas 13.11 and [3l3] give (cf. [GP, §6-7], [PI] and [P3]): 

C-W OK, C) X J] Sp(2n,, C) X J] GL(p„ C). 

In particular, the component group of C is 

A = 7ro(C) ~ (Z/2)^ 

where /c is the number of irreducible summands Mj of the same type as M. 

For each such Mj, let be a simple reflection in the orthogonal group 0(mj). The 
images of the elements in A give a basis over Z/2Z. For any element a in C, we 
define 

= {m G M : am = -m} 

to be the —1 eigenspace for a on M. This is a representation of and the restricted 
pairing B : x ^ C is non-degenerate, of the same type as M. For the simple 
reflections Oj in C, 

M'^' = Mi 

are the irreducible summands of the same type as M. 

We can use these representations to define characters x : A ^ (±1). The basic idea 
is to define signed invariants d{M) = ±1 of representations M of WD, which are either 
selfdual or conjugate-dual. 

Proposition 4.1. Let d{M) he an invariant of selfdual or conjugate- dual representa- 
tions, taking values in ±1. Assume that 

(1) d{M + M') = d{M) ■ d{M') 

(2) the value d{M'^) depends only on the image of a in the quotient group A = C/C^. 
Then the function 

X{a) = d{M'^) 

defines a character of A. 
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Indeed, the different classes in A are all represented by commuting involutions in C, 
and for two commuting involutions a and b we have the formula: 

M"^ + 2(M" n M^) = + M*" 

as representations of WD. Hence x(a6) = x(a) • 

The simplest example of such an invariant, which applies in both the conjugate-dual 
and the selfdual cases, is 

d{M) = (-l)dimM_ 

Since dim (mod 2) depends only on the coset of a (mod C°), this gives a character 
of A: 

77(a) = (-l)dimM«_ 

Now assume M is selfdual. The character rj is trivial when M is symplectic, as 
dimM" is even for all a in Sp(M) = G{M, B). In the orthogonal case, dimM" is even 
precisely for elements a in the centralizer which lie in the subgroup SO(M, B) of index 
2 in 0(M, B). Wc denote this subgroup by . 

An element c oi /k^^ gives a character 

Tjcia) = (det M«)(c) 

of A. Indeed, the quadratic character det M" depends only on the coset of a (mod C°). 
Since rjcd = ?7c%, we get a pairing 

{c,a):k''/k''^xA^{±l) 

which is trivial in the symplectic case. 

To construct other characters of A, we need more sophisticated signed invariants 
d{M) of selfdual or conjugate-dual representations. We will obtain these from local 
root numbers, after recalling that theory in the next section. 

5. Local root numbers 

Let M be a representation of the Weil-Deligne group WD of a local field k, and 
let ip he a. nontrivial additive character of k. In this section, we define the local root 
number e(M, following the articles of Tate [T] and Deligne [Del]. We then study 
the properties of these constants for selfdual and conjugate- dual representations, and 
give explicit formulae in the orthogonal and conjugate-orthogonal cases. The local 
root numbers arc more mysterious in the symplectic and conjugatc-symplcctic cases. 
Indeed, they form the basis of our conjectures on the restriction of representations of 
classical groups over local fields. 

Let dx be the unique Haar measure on k which is selfdual for Fourier transform with 
respect to ■0- For a representation M of the Weil group W{k), we define 

e(M,'0) = e(M, -0,^^,1/2) in C^, 
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in the notation of [Del, §4-5]. Tliis is tlic local constant eL(M, ■?/') in [T, 3.6.1]. In 
the non-archimedean case, if M is a representation of WD — W{k) x SL2(C), we may 
write 

M = ^ M„ Sym" 

n>0 

with each M„ a representation of the Weil group. We define (cf. [GR, §2]): 

e{M,^) = J]e(M„,V')"+' •det(-F|M„0" 

n>0 

This constant depends only on the isomorphism class of M. 

The following formulae involving e(M, ip) are well-known [T, 3.6], for representations 
M of the Weil group W{k). For a in A;^, let ■0a be the nontrivial additive character 
ipa{x) — i^iax). Then 

e(M,'0a) = det M(a) • e{M,ilj), 

e(M,^/;) •e(M^,V'-^) = 1. 
Since ip"^ — we conclude that 

e(M, i/j) ■ e{M^,ilj) = det M(-l). 

For representations M — J2 ® Sym" of WD in the non-archimedean case, we 
have 

= ^M;;f 0Sym", 
det(M) = JJdet(M„)"+^ 

n>0 

This allows us to extend the above formulas to the local root numbers e(M, ^) of 
representations of WD. 

Now let a be an involution of k, and define = ip{x'^). Then e{M'^,i/j'^) — 

e{M,ijj). If we assume further that ip"' = then 

e(M,^) •e('^MV,V') = e(M, 0) ■ e(M^, ^'^) 

= 1. 

When we apply these formulas to selfdual and conjugate-dual representations, we ob- 
tain the following. 



RESTRICTION PROBLEMS FOR CLASSICAL GROUPS 



17 



Proposition 5.1. (1) Assume that M is a selfdual representation of WD with 
det(M) = 1. Then e(M) = e{M,ip) is independent of the choice of ip and 
satisfies 

e{Mf = 1. 

Furthermore, if M is of the form M ^ N + N'^ , then e(M) = det A^(-l). 

(2) Assume that M is a conjugate-dual representation of WD and that the additive 
character ipo of k satisfies ipg — ip^^. Then 

Furthermore, if M is of the form M = N + '^iV^, then e(M, ipo) = 1. 

Since we are assuming that the characteristic of k is not equal to 2, the characters 
of k which satisfy = are precisely those characters which are trivial on ko, the 
fixed field of a. These characters form a principal homogeneous space for the group kg , 
and the value e(M, ipg) depends only on the N/c^-orbit of ipg. Indeed det M is conjugate- 
dual and hence trivial on NA;^ C /cq . If detM is conjugate-orthogonal, the restriction 
of det M to /cq is trivial, and hence the value e(M) = e(M, ■0o) is independent of the 
choice of ipQ. 

Following Dcligne [De2], we can say more when the selfduality or conjugate-duality 
of M is given by a pairing B with sign 6 = + 1 . Recall the spin covering of the special 
orthogonal group, which gives an exact sequence: 

1 ^ Z/2 ^ Spin(M) ^ SO(M) ^ 1. 

Proposition 5.2. (1) Assume that M is an orthogonal representation and that 
det(M) = 1. Then the root number e(M) = e{M,ip) is independent of the 
choice of ip and satisfies e(M)^ = 1. Furthermore e{M) — +1 if and only if 
the representation (f : WD — > SO(M) lifts to a homomorphism (p : WD — > 
Spin(M). 

(2) Assume that M is a conjugate-orthogonal representation and that = ^q^. 
Then the root number e(M) = e(M, ■0o) is independent of the choice of ipQ and 
satisfies e(M) = +1. 

Proof. The orthogonal case was proved by Deligne [De2] ; we note that in our case the 
characteristic of k is not equal to 2. We will deduce the second result for conjugate- 
orthogonal representations of W{k) from Deligne's formula, combined with the work of 
Frohlich and Queyrut [FQ]. The extension of the second result to conjugate-orthogonal 
representations of the Weil-Deligne group WD is then an amusing exercise, which we 
leave to the reader. 
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If M is conjugate-orthogonal and dim(M) = 1, we have seen that M corresponds to 
a complex character x of the group k^/k^. By [FQ, Thm 3], we have the formula 

e(x,^(Tr)) = x(e) 

where ip is any non-trivial additive character of and e is any nonzero element of k 
with Tr(e) = in ko. The element e is well-defined up to multiplication by /cq , and 
is an element of k^ . If we define the additive character ipo of k by 

ipo{x) = ip{TT{ex)) 

then (V'o)'^ = (V'o)"^) and 

e(M) = e(x,V'o)=x(ef = +1. 
This establishes the formula when M has dimension 1. 

Since the desired formula is additive in the representation M of W{k), and is true 
when dim(M) = 1, we are reduced to the case of conjugate-orthogonal representations 
M of even dimension. Then = Ind(M) is an orthogonal representation of deter- 
minant 1. Let ^ be a nontrivial additive character of ko] by the inductivity of local 
epsilon factors in dimension zero [Del]: 

e(iV,^)/e(P,^)<^™W = e(M,V^(Tr))/e(C,^(Tr))'^^'"W 

with C the trivial representation and P — Ind(C) the corresponding induced represen- 
tation, which is orthogonal of dimension 2 and determinant cu. Since e(C,'0(Tr)) = 1 
and e(P, ■0)^ = u;{—l), we obtain the formula 

e(A^) = e(A^, i^) = . e{M, V'(Tr)). 

On the other hand, we have 

e(M) = e(M,V^o) = det(M)(e) • e(M,V^(Tr)), 

where e is a nonzero element of k with Tr(e) = in ko. Hence, to show that e(M) = 
we are reduced to proving the formula 

e(A^) = det(M)(e) • 

for the root number of the orthogonal induced representation N. To do this, we combine 
Deligne's formula for the orthogonal root number with the following. 

Lemma 5.3. Let M be a conjugate-orthogonal representation ofW{k) of even dimen- 
sion. Then N — Ind(M) is an orthogonal representation ofW — VF(/co) of determinant 
1. The homomorphism (p : W ^ SO(iV) lifts to a homomorphism (f :W ^ Spin(A^) if 
and only z/detM(e) ■ uj{-iy^''^y^ = +1. 
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Proof. Let T be the maximal torus in SO(A^) which consists of the rotations Zi in 
n = dim(M) orthogonal planes. The restriction of the spin covering Spin(A^) SO(A^) 
to the torus T is the two-fold covering obtained by pulling back the spin covering z ^ z'^ 
of under the map F{zi, ■ ■ ■ , Zn) = Y[ Zi. 

The image of the map ip : W ^ SO(A^) lies in the normalizer of the Levi subgroup 
GL(M) which fixes the decomposition N = M + into maximal isotropic dual 
subspaces. There is an involution j of which switches the subspaces M and M^. 
Since det(j) = (—1)" and n = dim(M) is even, this involution lies in SO(A^). The 
normalizer of the Levi is the semi-direct product GL(M) ■ j. 

Since j has n eigenvalues which are +1, and n eigenvalues which are —1, if we view 
this involution as a product of rotations {zi, - ■ ■ , Zn) in orthogonal planes, we get n/2 
values Zi = —1 and n/2 values Zi = +1. Hence the involution j lifts to an element of 
order 2 in Spin(A^) if and only if n = dim(M) is divisible by 4. Since the subgroup 
SL(M) is simply-connected, it always lifts to Spin(A^). Hence the spin cover of GL(M) 
is obtained by taking the square root of the determinant of M , via the formula for the 
covering of T given above. 

We now consider the homomorphism 

(f):W GL(M) ■ J 

whose projection to the quotient (j) is the quadratic character u of Gal{k/kQ). The 
determinant of M corresponds to a character 

by local class field theory. The character x of A;^ //cq is a square if and only if x(e) = +1, 
where e is a nonzero element of k with trace zero to /cq. Indeed, e generates the 2- 
torsion subgroup of the one dimensional torus k^ /k^ . On the other hand, the quadratic 
extension k of /cq can be embedded in a cyclic quartic extension of k^ if and only if 
the character u of k^ is a square, or equivalently, if and only if 1) = 1. Hence the 
parameter 

(j):W ^ GL(M) ■ J ^ SO(A^) 
lifts to Spin(Ar) if and only if x(e) ■ cj(-l)di'^(*^)/2 = +1. □ 

This - together with the extension to representations of WD{k) - completes the proof 
of Proposition 15.21 □ 

6. Characters of component groups 

In this section, we will use the results of the previous section on local root numbers, 
together with Proposition 14.11 to construct characters of the group A of components 
of the centralizer C of (M, B). 
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First assume M and are conjugate selfdual representations, with signs h{M) and 
h{N). Fix ^0 with ^'^ = ip^'^, and for a in Cm C G{M, B), define 

XN{a)=e{M^(»N,^o)- 

Theorem 6.1. (1) The value XAr(a) depends only on the image of a in Am, and 
defines a character xn '■ Am — > (±1) 

(2) Ifb{M) ■ b{N) = +1, then xn = I on Am- 

(3) Ifb{M) ■ b{N) = -1, let ip'o{x) = ipo{tx) with t the nontrivial class in /Nk'' , 
and define 

x'^(a)=e(M'^®iV,^;). 

Then 

x'^ = Xiv^'^^'"(^^GHom(AM,±l), 
where the character rj of Am is defined by rj^a) = (—i^dimM"^ 

Proof. The first statement is proved using the same argument as [GPl, §10]. For an 
element a in 

Cm ^ n C) X J] Sp(2n„ C) x J] GL(p„ C), 

we find that XN^ci) depends only on the image in the component group. 

When b{M) ■ b{N) = +1, the representations ® N are all conjugate-orthogonal 
by Lemma [3751 so xn = 1- 

The final statement follows from the formula 

X'^(a) = Xjv(a) ■det(M"®iV)(t) 

and the calculation of the sign of the conjugate-dual representation which is the deter- 
minant of the tensor product. □ 

We use this theorem to define the quadratic character 

XAr(«A/) ■ XM{aN) 

on elements (omjOat) in the component group Am x Ajy. Here M and are two 
conjugate dual representations, although by part 2 of Theorem 16. II the character xn x 
Xm can only be non-trivial when b{M) ■ b{N) = —1. 

The case when M and are selfdual with signs b{M) and b{N) is more complicated. 
First, the function 

Xjv(a) = e(M''®iV,^) 

on Cm need not take values in ±1. Indeed 

XN{af = det(M" ® N){-1) = ±1. 

Even when det(M" ® A^) = 1 for all a in Cm, the value Xn{0') = =tl may not be 
constant on the cosets of Cm- For example, when M = P + with P irreducible and 
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not isomorphic to and N is the trivial representation C of dimension 1, we have 
Cm = GL(1,C). But 

Xiv(-l) = e(M ®N,^)= e(M, ^) = det P(-l), 

which need not be equal to XAf(l) = 1- 

When —1 is a square in , however, these problems do not arise and xn defines a 
character of Am as above. In the general case, we will only consider selfdual represen- 
tations M and of even dimension, and elements a in the subgroup C^j of Cm, where 
det(a|M) = +1. Then dim(M") is also even, and 

det(M" ^N) = det(M'')'^'"^(^) ■ det{Nf''^'^^^^ 

is clearly trivial. In particular, e{M"' ^N, ip) = e{M"' ® N) is independent of the choice 
of additive character ip and satisfies e{M°'®NY = +1- We correct this sign by another 
square root of det(M" ® A^)(— 1), and define 

Theorem 6.2. (1) The value Xn{(i) depends only on the image of a in A\j, and 
defines a character xn '■ A\j ^ (±1) 

(2) Ifb{M) ■ b{N) = +1, then xjv(a) = (det M^ det iV) . 

Proof. Again, this follows from the method of [GPl, §10]. We note that C° C C+ C C, 
so the component group A'^ has index either 1 or 2 in A. □ 

We use this theorem to define the quadratic character 

on elements (a^f , oat) in the component group A\j x A^, for two selfdual representations 
M and of even dimension. As in the conjugate-dual case, it follows from Theorem 
16.2( 2) that the character xn x Xm is only interesting when h{M) ■ b{N) = — 1. When 
the representations M and A^ are both symplectic, x = 1- When M and A^ are both 
orthogonal, the character x is given by a product of Hilbert symbols 

XJv(aAf) ■ XmM = (det M'^^^ det A^) ■ (det M, det A^"^). 

7. L-GROUPS OF CLASSICAL GROUPS 

Having defined representations, selfdual representations, and conjugate-dual repre- 
sentations M of the Weil-Deligne group WD of k, our next goal is to relate these to 
the Langlands parameters of classical groups. Before doing that, we recall the L-group 
attached to each of the classical groups, with particular attention to the L-groups of 
unitary groups. 
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If G is a connected reductive group over ko, the L-group of G is a semi-direct product 

= G X Gei\{K/ko) 

where G is the complex dual group and 7^ is a splitting field for the quasi-split inner 
form of G, with Gal{K / ko) acting on G via pinned automorphisms. For G = GL(V^), 
we have G = GL(M) with dimM = dim V. If {ei, • • • , e„} is the basis of the character 
group of a maximal torus T C G given by the weights of V, then the weights of the 
dual torus T" on M are the dual basis {e[, • • • , e'„}. 

Now assume that G C GL{V/k) is a connected classical group, defined by a a- 
sesquilinear form (, ) : V xV ^ k of sign e. The group G and its dual group G, as well 
as the splitting field K of its quasi-split inner form, are given by the following table: 



{k,e) 


G 


G 


K 


^G 


k — ko 
e= 1 


so(y), 

dim V ^2n + l 


Sp2n(C) 


ko 


Sp2n(C) 


k = ko 

6= 1 


SO{V), 
dim V = 2n 


S02„(C) 


ko{^disc{V)) 


02„(C) (disc(l^) ^ 

S02n(C) (disc(F) e 


k — ko 
e= -1 


Sp{V), 
dim V — 2n 


S02n+l(C) 


ko 


S02„+i(C) 


k ^ ko 
e = ±1 


dim V — n 


GL,(C) 


k 


GL„(C) X Gsl{k/ko) 
— L-group of compact U(n) 



From the above table, we note that the L-group GL(M) x Gal(/c//co) of U(y) is 
isomorphic to the L-group of the anisotropic real group U(n), associated to a definite 
hermitian space of the same dimension as V over C. 

Before specializing to the case of unitary groups, let us make some general obser- 
vations on the representation theory of the L-groups of anisotropic groups over M. In 
this case, we have 

^G = GxGal(C/K), 

where the Galois group acts by a pinned involution (possibly trivial), which maps to 
the opposition involution in Out(G) and takes any representation V to its dual . 
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The pinning of G gives a principal SL2 in G, which is fixed by the action of Gal(C/M), 
so that we have 

5 : SL2 X Gal(C/R) ^ G x Gal(C/K). 

Let e in Z{G)'^^^''^/^^ be the image of — / in SL2. Then — 1 and e acts as a scalar on 
every irreducible representation of ^G. The following result is due to Deligne. 

Proposition 7.1. Let G he an anisotropic group over R. Then every complex rep- 
resentation N of ^G is selfdual. If N is irreducible, the ^G -invariant pairing {,)n '■ 
N X N ^ C is unique up to scaling, and is {e\N) -symmetric. 

Proof The proof is similar to Bourbaki [B, Ch. VIII, §7, Prop. 12 and Ex. 6], 
which treats the irreducible, selfdual representations M of G. There one restricts the 
pairing on M to the highest weight summand for the principal SL2, which occurs with 
multiphcity one. In this case, we restrict the pairing on to the subgroup SL2 x 
Gal(C/M), which again has an irreducible summand which occurs with multiplicity 1. 
The sign (e|A^) is the sign of — / on this summand, which determines the sign of the 
pairing. □ 

If M is an irreducible representation of G which is selfdual, then M extends in two 
ways to ^G. If M is not isomorphic to M^, then the induced representation 

N = Ind(M) 

of ^G is irreducible. If we restrict N to G, it decomposes as a direct sum 

M + a-M^M + M"" 

where a generates Gal(C/M). Since M is not isomorphic to M^, the subspaces M and 
a • M oi N are isotropic for the pairing (, )Ar, which gives a non-degenerate pairing 
(, )m : M X M ^ C defined by 

(7.2) {m,m')M = {m,am')j^. 

This is a conjugate-duality on M : for g in G, we have 

{gm,aga-^m')M = {m,m')M 
{m',m)M = (e|M) • {m,m')M 



We now specialize these arguments to the case of unitary groups. Since the represen- 
tation of the principal SL2 — > GL(M) on M is irreducible and isomorphic to Sym"~^, 
we have 

(e|M) = (-1)"-^ 

Hence the selfduality on N and the conjugate-duality on M are (— l)"^~^-symmetric. 
In particular, we have 
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Proposition 7.3. If G = UiV), with dimfc V = n, then 

Lq ^ fSp(iV) = Sp2„(C), ifn is even; 
^ \ 0{N) = 02„(C), zfn IS odd. 

In each case, is identified with the normalizer of a Levi subgroup of a Siegel parabolic 
subgroup in Sp2„(C) or 02n(C). 

Finally, it is instructive to describe the L-groups of the classical groups from the 
point of view of invariant theory. As one observes from the above table, the L-groups of 
symplectic and orthogonal groups G{V) are themselves classical groups over C and have 
natural realizations as subgroups of GL(M) for complex vector spaces M of appropriate 
dimensions. These subgroups can be described as follows. One has a decomposition 

2 

M®M^ SjmHl /\ M 

of GL(M)-modules. The action of GL(M) on Sym^M or A^M has a unique open 
orbit consisting of nondegenerate symmetric or skew-symmetric forms on M^. Then 
we note: 

(i) The stabilizer of a nondegenerate vector B in Sym^M (resp. A^M) is the orthog- 
onal group 0(M, B) (resp. the symplectic group Sp(M, B)); these groups exhaust 
the L-groups of symplectic and orthogonal groups. 

(ii) The action of this stabilizer on the other representation A^M (resp. Sym^M) is 
its adjoint representation. 

(iii) The two representations Sym^M and A^M are also useful for characterizing the 
selfdual representations of WD{k) introduced in [|3j a representation M of WD{k) 
is orthogonal (resp. symplectic) if and only if WD{k) fixes a nondegenerate vector 
in Sym^M (resp. A^M). 

These rather obvious remarks have analogs for the unitary group U(l^), which we 
now describe. Suppose that the L-group of 'U{V) is GL(M) x GaA{k/ko). Consider the 
semi-direct product 

H = (GL(M) X GL(M)) x Z/2Z 

where Z/2Z acts by permuting the two factors of GL(M); this is the L-group of 
ReSfc/fco(GL(y/A;)) with dim^ \^ = dimM. The irreducible representation M Kl M of 
= GL(M) X GL(M) is invariant under Z/2Z and thus has two extensions to H. In 
one such extension, the group Z/2Z = 5*2 simply acts by permuting the two copies of 
M; the other extension is then given by twisting by the nontrivial character of H/H^. 
In honor of Asai, we denote these two extensions by As^(M) and As~(M) respectively. 
They can be distinguished by 

Trace(c|As+(M)) = dimM and Trace(c|As"(M)) = - dimM, 
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where c is the nontrivial element in 'L/2'L. One has 

Indfo(MKM) = As+(A/r)0As-(M). 

The action of on As=^(M) has an open dense orbit, consisting of isomorphisms 
— >■ M and whose elements we call nondegenerate. Now we have 

Proposition 7.4. //dimM = n, then the stabilizer in GL(M) x GL(M) of a nonde- 
generate vector in As*^^^-* (M) is isomorphic to the L-group ofUiV). Moreover, the 
action of this stabilizer on the other representation As^^^^" (M) is the adjoint represen- 
tation of^U{V). 

The representations As^(M) are also useful for characterizing conjugate-dual repre- 
sentations of WD, which were discussed in ^ Indeed, given a representation 

^ : WD{k) GL(M), 

one obtains a map 

<P : WD{ko) H 

by setting 

^(r) = {^{T),ip{sTs-^)) G GL(Af) X GL(M), 

for r e WD{k), and 

The choice of s is unimportant, since the maps <^'s thus obtained for different choices 
of s are naturally conjugate under H^. Through this map, WD{ko) acts on As^(M). 
In fact, the representation As'''(M) of WD{ko) is obtained from M by the process 
of multiplicative induction [P2] or twisted tensor product; it is an extension of the 
representation M M'" of WD{k) to WD{ko), and As"(M) is the twist of As+(M) 
by the quadratic character ci^fc/feo associated to the quadratic extension k/k^. 

Now we have: 

Proposition 7.5. If M is a representation ofWD(k), then 

(i) M is conjugate-orthogonal if and only ifWD{kQ) fixes a nondegenerate vector in 
As+(M). When M is irreducible, this is equivalent to As+(M)'^^(''o) ^ 0. 

(a) M is conjugate-symplectic if and only ifWD{ko) fixes a nondegenerate vector in 
As"(M). When M is irreducible, this is equivalent to As~ {M)^^^''°^ ^ 0. 
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8. LANGLANDS parameters FOR CLASSICAL GROUPS 

In this section, we discuss the Langlands parameters of classical groups. In particu- 
lar, we show that these Langlands parameters can be understood in terms of selfdual 
or conjugate-dual representations M of WD{k). 

If G is a connected, reductive group over ko, a Langlands parameter is a homomor- 
phism 

(p : WD{ko) ^^G^Gx Geil{K/ko). 

This homomorphism is required to be continuous on WD = W{ko) when fco = 11^ on 
C. In the non-archimedean case, it is required to be trivial on an open subgroup of 
the inertia group, and the image of Probenius is required to be semi-simple. In all 
cases, the projection onto Ga\{K/ko) is the natural map W{kQ)/W{K) — > Gal{K/ko). 
Finally, two Langlands parameters are considered equivalent if they are conjugate by 
an element in G. 

Associated to any Langlands parameter is the reductive group 

G^CG 

which centralizes the image, and its component group 

— G^/ C°. 

The isomorphism class of both G^p and are determined by the equivalence class of 
the parameter (p. 

For G = GL{V/ko), we have G = GL(M) with dim M = dim V. If (ei, ■ ■ ■ , e„) is the 
basis of the character group of a maximal torus T G G given by the weights of V, then 
the weights of the dual torus T on M are the dual basis {e'l,--- , e^). The Langlands 
parameters for G are simply equivalence classes of representations of WD(ko) on M. 

Now assume that G C GL{V/k) is a connected classical group, defined by a a- 
sesquihnear form {,) : V x V ^ k oi sign e. We will see that for each classical group 
G, a Langlands parameter (f for G corresponds to a natural complex representation 

WD{k) GL(M) 

with some additional structure, as given in the following theorem. 

Theorem 8.1. (i) A Langlands parameter (p of the connected classical group G C 
GL{V/k) determines a selfdual or conjugate- dual representation M of WD{k), with 
the following structure: 
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G 


dim(\/) 


M 


dimM 






2n 


Orthogonal 


2n + l 


det M = 1 


S0(\/) 


2n + 1 


Symplectic 


2n 




S0(\/) 


2n 


Orthogonal 


2n 


det M = disc V 


U(V) 


2n + l 


Conjugate-orthogonal 


2n + l 




u(y) 


2n 


Conjugate-symplectic 


2n 





(a) The isomorphism class of the representation M determines the equivalence class 
of the parameter ip, except in the case when M is orthogonal and every irreducible 
orthogonal summand Mi of M has even dimension. In the exceptional case, M and V 
have even dimension and there are two equivalence classes {ip, ip'} of parameters for 
SO{y) which give rise to the same orthogonal representation M . 

(Hi) In the unitary cases, the group C G which centralizes the image of ip is 
isomorphic to the group C of elements a in Aut{M,B) which centralize the image 
WD{k) GL(M). In the orthogonal and symplectic cases, the group G G 
is isomorphic to the subgroup of G , consisting of those elements which satisfy 
det{a\M) = 1. 

Proof. This is well-known if G is an orthogonal or symplectic group. Indeed, the 
L-group ^G is essentially the automorphism group of a nondegenerate symmetric 
or skew- symmetric bilinear form B on a complex vector space M of appropriate 
dimension. So the theorem amounts to the assertion that if two homomorphisms 
WD{k) —y Aut(M, S) C GL(M) are conjugate in GL(M), then they are conjugate 
in Aut{M,B). This is the content of Lemma 13.1 [ Moreover, the description of the 
component group G^ follows directly from the results of §H 

Henceforth we shall focus on the unitary case. For G = 'U{V), a parameter is a 
homomorphism 

ip : WD{ko) GL(M) x Gal(A;/A;o) 

with dim M = dim V = n. Again, we normalize M so that the weights for T on M are 
dual to the weights for the torus T = U(l)" on V. The restriction of ip to WD{k) gives 
the desired representation M. We must next show that M is conjugate-dual with sign 
(-If-i. 



28 



WEE TECK GAN, BENEDICT H. GROSS AND DIPENDRA PRASAD 



If s generates the quotient WD{ko)/WD{k), then 

ip{s) = {A, a) = (A 1)(1, a) in 

with A in GL(M). In the previous section (cf. equation (17.21) ). we have seen that the 
standard representation M of GL(M) has a conjugate-duahty (— , —)m of sign (— 1)*^"^ 
with respect to the nontrivial element a G Gal{k/ko) C ^G. We define the bilinear 
form 

B{m,m') = Bs{m,m') = {m, A~^m') m, 
Then the form B is non-degenerate on M and satisfies 

B^rm, STS~^m') = B{m, m') 

for all r in WD, and 

B{m\m) = (-1)'""^ ■ B{m,s'^m'). 
Hence M is conjugate-dual with sign = (—1)"^^. 

It is clear that the conjugation of a parameter ip by an element of GL(M) gives an 
isomorphism of the associated conjugate-dual representations. Hence we are reduced 
to showing that every conjugate dual representation M of sign = (—1)""^ extends to a 
Langlands parameter (f of WD{ko), and that the isomorphism class of M determines 
the equivalence class of (p. 

Suppose then that M is a conjugate-dual representation of WD{k) of sign = (— 1)"~^ 
with n = dimM. To obtain an extension, consider the induced representation = 
Ind(M) of WD^ko). By Lemma [375l (i). N is selfdual of sign = (—1)"^^. Moreover, the 
proof of Lemma [331 shows that the image of WD{ko) in Sp(4(i) or 0(4(i+2) (depending 
on whether = 2(i or n = 2(i-M) is contained in the normalizer of a Levi subgroup in a 
Siegel parabolic subgroup. By Proposition 17.31 this normalizer is isomorphic to the L- 
group of U(V^): it splits as a semi-direct product GL(M) x (a), with det(Q;|A^) = (— 1)". 
Thus, we have produced an L-parameter for U{V) whose restriction to WD{k) is the 
given M. 

Finally we need to show that the extension obtained above is unique, up to conjugacy 
by G. If if and if' are two parameters extending p : WD{k) —>■ GL(M), we must show 
that the elements 

ifis) = {A, a) 

ip'is) = iA',a)oi^G 

are conjugate by an element of GL(M) centralizing the image of p. The bilinear forms 

B{m,m') = {m, A~^m')M 
B'{m,m') = {m,{A')~^m')M 

give two conjugate-dualities of M which are preserved by WD{k) and non-degenerate 
with sign (—1)"^^. By Lemma [3.31 there is an element T in GL(M) centralizing the 
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image of p with 

B'{m,m') = B{Tm,Tm'). 

This gives the identity 

(m, {A')-^m') = (m, {T~Y^'^Tm') 

for all m and m'. Hence 

A' = T-^AT'^ 

and the elements are conjugate by the element T G GL(M) = G. 

The argument identifying the group with either the group C or of (M, 5) is 
contained in §H This completes the proof of the theorem. 

□ 

Corollary 8.2. A representation M ofWD{k) gives rise to a Langlands parameter for 
a quasi-split unitary group U(V) if and only ifWD{ko) fixes a non-degenerate vector 
in As(~^^""'(M), with n = dimM. 

Proof. This is a consequence of the theorem and Proposition 17.51 □ 



Remark: When M is orthogonal of even dimension, it is often convenient to view it 
as defining a unique Langlands parameter for the full orthogonal group 0(\^) (which 
is not connected), with the equivalence being defined by 0(M)-conjugacy; see [PI]. 

We obtain the following simple invariants of the representation M. For G = GL{V) 
we have the character 

detM : A;^ ^ C\ 
For G = U{V), we obtain the character 

detM-.k^'/k^ 

as the sign of det M is = +1. Finally, for G = Sp{V) or G = SO{V) with 

dim(K) even and disc(V") = 1, the representation M is orthogonal with det(M) = 1. 
Hence we have the root number e(M) = e(M, ip) independent of the additive character 
ip of k, and 

e(M) = ±1. 

We will relate these invariants to the central characters of certain representations of G 
after introducing Vogan L-packets in the next section. 
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9. VOGAN L-PACKETS - DESIDERATA 

Let G be a quasi-split, connected, reductive group over a local field ko. In this 
section, we will discuss Langlands parameters </? as the conjectural parameters for the 
isomorphism classes of irreducible smooth admissible complex representations of the 
locally compact group G{kQ). Before coming to that, we briefly recall the notions of 
smooth and admissible representations of G{ko) when kg is a local field. 

When ko is local and discretely valued, a smooth representation tt is simply a homo- 
morphism 

TT : G{ko) — > GL{E) 
for a complex vector space E (possibly infinite-dimensional) such that 

E = UkE^, 

where the Tinion is over all open compact subgroups K of G{ko). Such a smooth 
representation is admissible if E^ is finite dimensional for any open compact subgroup 
K. A homomorphism from (tt, E) to (tt', E') is simply a linear map E — > E' which 
commutes with the action of Giko). 

When /cq = or C, we will consider the category of smooth Frechet representations 
(7r,£') of moderate growth, as introduced by Casselman [C] and Wallach [Wl]. An 
admissible representation is such a representation whose subspace of X-finite vectors 
(where X is a maximal compact subgroup of Giko)) is the direct sum of irreducible 
representations of K with finite multiplicities. A homomorphism (tt, E) — (tt', E') is 
a continuous linear map E — > E' which commutes with the action of G{ko). 

We come now to the local Langlands conjecture. We shall present this conjecture in 
a form proposed by Vogan [Vo] , which treats representations tt of all pure inner forms 
G' of G simultaneously. 

All of the pure inner forms G' of G have the same center Z over ko, and each 
irreducible representation tt of G'(A:o) has a central character 

uj^ : Z{ko) C\ 

The adjoint group G'a^(A;o) acts on G'{ko) by conjugation, and hence acts on the set of 
its irreducible complex representations. The quotient group G^^(/co)/Im G'{ko) acts on 
the set of isomorphism classes of representations of G'{ko). This quotient is abelian, 
and canonically isomorphic to the cohomology group 

E = keT{H\ko, Z) H\ko, G')). 

Let S be a Borel subgroup of G over ko, with unipotent radical A^. The quotient 
torus T — B/N acts on the group Hom(A^, C^). We call a character 9 : N{ko) 
generic if its stabilizer in T{ko) is equal to the center Z{ko)- If tt is an irreducible 
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representation of G{ko) and 6* is a generic character, then the complex vector space 
Homjv(fco)(7i', ^) has dimension < 1. When the dimension is 1, we say tt is ^-generic. 
This depends only on the T'(/co)-orbit of 9. 

When Z — 1, the group T^k^) acts simply-transitively on the set of generic charac- 
ters. In general, the set D of T(A;o)-orbits on the set of all generic characters 9 of N{ko) 
forms a principal homogeneous space for the abelian group E, which is also isomorphic 
to 

Tad(ko)/lm T(ko)^ker{H\ko,Z) ^ H\ko,T)). 

We are now ready to describe the desiderata for Vogan L-packets, which will be 
assumed in the rest of this paper. These properties are known to hold for the groups 
GL{V) and SL{V), as well as for some classical groups of small rank. 

(1) Every irreducible representation tt of G' (up to isomorphism) determines a 
Langlands parameter 

ip : WD{ko) ^ G X Gal{K/ko) 

(up to equivalence). 

Each Langlands parameter (p for G corresponds to a finite set 11^ of irre- 
ducible representations of G{ko) and its pure inner forms G'{ko). Moreover, the 
cardinality of the finite set U^p is equal to the number of irreducible represen- 
tations X oi the finite group A,^ = 7ro(C<^). 

(2) Each choice of a T(A;o)-orbit 9 of generic characters for G gives a bijection of 
finite sets 

J{9) : ^ Irr(A^). 

The L-packet H^p contains at most one ^'-generic representation, for each T- 
orbit of generic characters 9' of G. It contains such a representation precisely 
when the adjoint L-function of (f is regular at the point s = 1. In this case, we 
say the L-packet H^p is generic. 

Assume that the L-packet 11^ is generic. In the bijection J (9), the unique 
^-generic representation tt in 11^ corresponds to the trivial representation of 
A^. The ^'-generic representations correspond to the one dimensional represen- 
tations Tjg described below. 

(3) The finite set 11^ of irreducible representations is stable under the adjoint ac- 
tion, which permutes the different generic representations for G in an L-packet 
transitively. 

In any of the bijections J (9), the action of g E G'^{ko) on lix^A^p) is given 
by tensor product with the one-dimensional representation r]g of Aip alluded to 
above. 



32 



WEE TECK GAN, BENEDICT H. GROSS AND DIPENDRA PRASAD 



More precisely, Tate local duality gives a perfect pairing 

H\ko,Z) X H\K/ko,n,{G)) ^ C\ 

The coboundary map — > H^{K/ko,7ri{G)) factors through the quotient A^, 
and gives a pairing 

H\ko,Z)xA^^C\ 

The adjoint action by the element g in G'^^{ko) H^{kQ, Z), viewed as a one 
dimensional representation rjg of A^, will take 7i{(p,x) to the representation 

(4) In any of the bijections J{0), the pure inner form which acts on the represen- 
tation with parameter (99, x) is constrained by the restriction of the irreducible 
representation x to the image of the group 7ro(2'(G))^'^'^^/*^°) in A^. 

More precisely, when kg ^ M, Kottwitz has identified the pointed set H^{ko, G) 
with the group of characters of the component group of Z{G)'^^^^^I^°\ The in- 
clusion 

induces a map on component groups, whose image is central in A^p. Hence an 
irreducible representation x of A^ has a central character on 7ro(2'(G))^^''^^/''"'', 
and determines a class in H^{ko,G). This is the pure inner form G' that acts 
on the representation 7r{(p,x)- 

(5) All of the irreducible representations tt in II,^ have the same central character 
a;^. This character is determined by ip, using the recipe in [GR, §7]. 

10. VOGAN L-PACKETS FOR THE CLASSICAL GROUPS 

We now make the desiderata of Vogan L-packets completely exphcit for the classical 
groups G C GL{V/k). We have already described the Langlands parameters cp for G 
explicitly, as certain representations M of WD = WD[k), in section 6. In all cases, 
the component group A^ is an elementary abelian 2-group, so Irr(A^) = Hom(A(^, ±1). 
We treat each family of groups in turn. 

The General Linear Group G = GL{V) 

(1) A Langlands parameter is a representation M of WD, with dim(M) = dim(K). 
The group = C{M) is connected, so A^p = 1. Hence H^^ consists of a single 
element. In this case, the full Langlands conjecture is known (by [HT] and 
[He]). 
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(2) There is a unique T-orbit on the generic characters, and the regularity of the 
adjoint L-function of at s = 1 detects generic L-packets U^. 

(3) The adjoint action is trivial, as the center Z oi G has trivial first cohomology. 

(4) The only pure inner form is G = GL(V^). 

(5) The center Z{k) = , and the central character of n{ip) has parameter det(M). 
The Symplectic Group G = Sp{V) 

(1) A Langlands parameter is an orthogonal representation M of WD, with 

dim(M) = dim{V) + 1 and det(M) = 1. 

The group = A~j^ has order 2™"^, where m is the number of distinct ir- 
reducible orthogonal summands Mj in M. The full Langlands conjecture is 
known when dim(V") = 2 [LL] or 4 [GT2]. 

(2) The set D of T-orbits on generic characters is a principal homogeneous space 
for the group E = H^{k,Z) = k^ /k^'^. We will see in 512] that the choice of 
the symplectic space V identifies the set D with the set of A; ^ ^-orbits on the 
nontrivial additive characters ip of k. 

(3) The adjoint action is via elements c in the group E = k^ /k^"^. This acts 
on the irreducible representations of A^p via tensor product with the character 
ric{a) = det(M") (c) , and on the set D of orbits of generic characters by mapping 
ipi^x) to ip{cx). 

(4) The only pure inner form is G = Sp(V"). 

(5) The center Z{k) = (±1), and the central character of vr(y9) maps the element 
—1 in Z{k) to the local root number e(M). 

The Odd Special Orthogonal Group G = SO{V), dim{V) = 2n + 1 

(1) A Langlands parameter is a symplectic representation M of WD, with dim(M) = 
dim(y) — 1. The group A^p = Am has order 2"^, where m is the number of dis- 
tinct irreducible symplectic summands Mi in M. The full Langlands conjecture 
is known when dim(\^) = 3 [Ku] or 5 [GTl]. 

(2) Since G is an adjoint group, there is a unique T-orbit on the set of generic 
characters, and hence a single natural bijection J : — > Hom(yl^, ±1). 

(3) The adjoint action on the L-packet is trivial. 
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(4) The pure inner forms of G are the groups G' = S0(1^'), where V is an orthog- 
onal space over k with dim(\^') = dim(\^) and disc(\^') = disc(\^). 

If k is non-archimedean and n > 1, there is a unique non-spht pure inner form 
G', which has fc-rank {n — 1). The representation 7r(y9,x) is a representation 
of G if = +1 cind a representation of G' if = ~1- If ^ = M and 

G = SO{p,q), then the pure inner forms are the groups G' = SO{p',q') with 
q' = q mod 2, and 7r((/), x) is a representation of one of the groups G' with 

(_l)(W)/2 ^ 

(5) The center Z of G is trivial. 

The Even Special Orthogonal Group G = SO{V), dim{V) = 2n, disc(\/) = d 

(1) A Langlands parameter determines an orthogonal representation M of WD, 
with 

dim(M) = dim(V^) and det(M) = C{d). 

The group = A^j has order 2"^, where m is either the number of distinct 
irreducible orthogonal summands Mj in M, or the number of distinct orthogonal 
summands minus 1. 

The latter case occurs if some irreducible orthogonal summand Mj has odd 
dimension (in which case the orthogonal representation M determines the pa- 
rameter if). If every irreducible orthogonal summand Mj of M has even dimen- 
sion, then A'Ij = Am and there are two parameters {(j), which determine the 
same orthogonal representation M. The representations 7c{(j),x) and 7r(0*,x) 
are conjugate under the outer action of 0(y) on SO(V^). 

The full Langlands conjecture is known when dim(V) = 2 or 4 or 6. 

(2) The set D of T-orbits on generic characters is a principal homogeneous space 
for the group E = NK^ /k^^ , where K is the splitting field of G. We will see 
in ^ IT2] that the choice of the orthogonal space V identifies the set D with the 
set of G-orbits on the set of non-isotropic lines L G V, such that the space L-*- 
is split. 

(3) The adjoint action is via elements c in the group E = NK^ /k^'^. This acts 
on the irreducible representations of A^ via tensor product with the character 
T]c{a) = det(M")(c), and on the set D of orbits of generic characters by mapping 
a line L = kv with {v, v) = a in k^ to a line L' = kv' with {v', v') = c ■ a. 

(4) The pure inner forms of G are the groups G' = SO{V'), where V is an orthog- 
onal space over k with dim(\^') = dim(\^) and disc(l^') = disc(\^). 

If k is non-archimedean and V is not the split orthogonal space of dimension 
2, there is a unique pure inner form G', such that the Hasse-Witt invariant of 
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V is distinct from the Hasse-Witt invariant of V. The representation 7r{(p,x) 
is a representation of G if x(— 1) = +1 and a representation of G' if x(— 1) = 
—1. If A; = M and G = SO{p,q), then the pure inner forms are the groups 
G' = SO{p',q') with q' = q mod 2, and 7r((^,x) is a representation of one of 
the groups G' with (-l)(9-9')/2 ^ ^(-l)- 

(5) If dim(y) = 2, then Z = G. If dim(y) > 4, then Z{k) = (±1) and the central 
character of 7r{(p) maps the element —1 in Z{k) to e(M, '0)/e(det M, -0). 

The Odd Unitary Group G = U{V), dim^ = 2n + 1 

(1) A Langlands parameter is a conjugate-orthogonal representation M of WD, 
with dim(M) = dim(y). The group — Am has order 2"^, where m is the 
number of distinct irreducible conjugate-orthogonal summands Mj in M. The 
full Langlands conjecture is known when dim(V^) = 1 or 3 [Ro]. 

(2) There is a unique T-orbit on the set of generic characters, and hence a single 
natural isomorphism J : 11,^ — > Hom(A<^, ±1). 

(3) The adjoint action on the L-packet is trivial. 

(4) The pure inner forms of G are the groups G' — U(y), where V is a hermitian 
(or skew- hermitian) space over k with dim(y) = dim(y). 

If kQ is non-archimedean, there is a unique pure inner form G' such that the 
discriminant of V is distinct from the discriminant of V. The representation 
71 {ip, x) is a representation ofGifx(— 1) = +1 and a representation of G' if 
x(— 1) = — 1. IfA;o = M and G — U(p, g), then the pure inner forms are the 
groups G' — U(p', q'), and 7r(</?, x) is a representation of one of the groups G' 
with (-!)«-«' = x(-l)- 

(5) The center Z{ko) = k^/k^ = U(l), and the central character of TT{ip,x) has 
parameter det(M). 

The Even Unitary Group G = \J{V), dimV = 2n 

(1) A Langlands parameter is a conjugatc-symplcctic representation M of WD, 
with dim(M) = dim(y). The group = Am has order 2™", where m is the 
number of distinct irreducible conjugate- symplectic summands in M. The 
full Langlands conjecture is known when dim(y) = 2 [Ro] . 
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(2) The set D of T-orbits on generic characters is a principal homogeneous space 
for the group E = H^{k,Z) = /Nk"" of order 2. We will see in §12] that 
the choice of a hermitian space V identifies the set D with the set of Nk^- 
orbits on the nontrivial additive characters ipo of k/k^. Similarly, the choice of 
a skew-hermitian space V identifies the set D with the set of N/c^ -orbits on the 
nontrivial additive characters ip of /cq- 

(3) The adjoint action is via elements c in the group E = k^ /Nk^ . The nontrivial 
class c acts on the irreducible representations of via tensor product with the 
character 77(a) = (_i)dim(M")^ ^^^^ ^^le set D of orbits of generic characters 
by mapping ipo^x) to ipo{cx), or ip{x) to ipicx). 

(4) The pure inner forms of G are the groups G' = \J{V'), where V is a hermitian 
(or skew-hermitian) space over k with dim(y) = dim(y). 

If kf) is non-archimedean, there is a unique pure inner form G' such that the 
discriminant of V is distinct from the discriminant of V. The representation 
71 {ip, x) is a representation of G if x(~l) = +1 and a representation of G' if 
x(— 1) = — 1. IfA;o = ]R and G = U{p,q), then the pure inner forms are the 
groups G' = U(p',g'), and 7i{(f,x) is a representation of one of the groups G' 
with (-1)"-'?' = x(-l)- 

(5) The center Z{kQ) = k^/k^ = U(l), and the central character of 7i{ip,x) has 
parameter det(M). 

The forthcoming book of Arthur [A3] and the papers [Mol, Mo2] of Moeglin should 
establish most of the above expectations. 

11. VOGAN L-PACKETS FOR THE METAPLECTIC GROUP 

Let {W, (— , —)w) be a symplectic space of dimension 2n > over the local field k. 
We assume, as usual, that char(fc) 7^ 2. In this section, we also assume that 7^ C. 

Let Sp(H^) denote the nontrivial double cover of the symplectic group Sp(W){k). 
We will use the Howe duality correspondence (also known as the theta correspon- 
dence) to describe the (genuine) representation theory of Sp(11/^) in terms of the rep- 
resentation theory of the groups SO(l^) over k, with dimV^ = 2n + 1. Assuming 
the Langlands-Vogan parameterization of irreducible representations of SO(l^) over k, 
with dimV^ = 2n + 1, we then obtain a notion of Vogan L-packets for the genuine 
irreducible representations tt of Sp(iy). More precisely, the Langlands parameter of a 
genuine representation of Sp(iy) will be a symplectic representation 

LP -.WD ^Sp{M) with dimM = 2n, 



RESTRICTION PROBLEMS FOR CLASSICAL GROUPS 



37 



and the individual representations 7i{ip,x) in the Vogan packet will be indexed by 
quadratic characters 

This parameterization of the irreducible genuine representations of Sp(M^) will de- 
pend on the choice of a nontrivial additive character of k, up to multiplication by 
k^'^. Such an orbit of additive characters t/j determines an orbit of generic characters 
^ : — > for Sp(Vl^). The character 9 also determines a character 9 of the unipo- 
tent radical A'^ ~ of Sp(VF). Our parameterization is normalized so that for generic 
parameters (p, the unique representation vf G II,^ which is ^-generic corresponds to the 
trivial character x = 1 of yl^. Such a dependence of the Langlands parameterization on 
the choice of an additive character ^p is already present in the case of the linear classical 
groups discussed in the previous section. For the metaplectic groups, the dependence 
is more serious: even the Langlands parameter (p associated to tt depends on the choice 
of ip. 

To define the parameters (</?, x) of tt, we let (V, q) be a quadratic space over k with 

dimy = 2n + 1 and disc(y) = (-l)"det(y) = 1 e A;^/A;^^ 

Note that the discriminant above refers to the discriminant of the quadratic space 
(y, q). The quadratic form qonV gives rise to a symmetric bilinear form 

{x, y)v = q(x + y)- q(x) - q(y) 

so that 

{x,x)v = 2 • q{x), 

and 

disc(y, (-, -)y) = 2 • disc(\/, g) = 2 e 

The space W <S>V is a symplectic space over k with the skew-symmetric form 

{-,-)w®{-,-)v, 
and one has the associated Heisenberg group 

H{W^V) = k®{W^V), 

which has a one dimensional center k. Associated to ip, H{W ® V) has a unique 
irreducible representation cu^ with central character ip (by the Stone-von-Neumann 

theorem). Now Sp{W ® V) acts as automorphisms of H(W (^V) via its natural action 
oylW^V and the trivial action on k. Thus uj^ gives rise to a projective representation 
of Sp(W^ ® V) and it was shown by Weil that this projective representation is a linear 

representation of Sp(iy ® V). We thus have a representation uj^ of the semi-direct 
product 

§p{W®V) K H(W0V). 
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This is the so-called Weil representation (associated to ip). As a representation of 
Sp(iy ®V), it is the direct sum of two irreducible representations, and its isomorphism 
class depends only on the /c^^-orbit of ■0- 

Via a natural homomorphism 

Sp(l^) X 0{V) — > Sp{W ® V), 

we regard the Weil representation ui^ as a representation uJwy,^ of Sp(iy) x 0{V). The 
theory of Howe duality gives a correspondence between irreducible genuine representa- 
tions TT of Sp(l^) and certain irreducible representations a of 0{V). 

More precisely, given an irreducible representation cr of O(l^), the maximal cr-isotypic 
quotient of uJw,v,'ii) has the form 

for some smooth representation Qwy,i){.(^) (the big theta lift of cr) of Sp(W^). It is 
known ([K] and [MVW]) that Qw.v,%i>{(^) is either zero or has finite length. Let 9wy,ii!{(^) 
(the small theta lift of a) denote the maximal semisimple quotient of 0w,y,i/,(cr). It is 
known by Howe [Ho] and Waldspurger [Wa3] that when the residue characteristic of 
k is different from 2, then 9wy,ti}{cF) is irreducible or zero; this is the so-called Howe's 
conjecture. In the following, we will assume that the same holds when the residue 
characteristic of A; is 2. 

Analogously, if tt is an irreducible representation of Sp(VF), we have the representa- 
tions Qwy^iiij^) and 9wy,^iT^) of 0(\^). 

Now we have the following theorem, which is due to Adams-Barbasch [AB] when 
k — M. and essentially due to Kudla-Rallis [KR] when k is non-archimedean. 

Theorem 11.1. Assume that the local field k is either real or non-archimedean with 
odd residual characteristic. Then corresponding to the choice of an additive character 
ip of k, there is a natural bijection given by the theta correspondence between 

l^irreducible genuine representations tt o/Sp(VF)| 

Y[ {irreducible representations a' of SO{V')} 

where the union is disjoint, and taken over all the isomorphism classes of orthogonal 
spaces V over k with dimV = 2n + 1 and disc(l^') = 1. 

More precisely, given an irreducible representation tt ofSp{W), there is a unique V' 
as above such that Owy','(i)ij^) is nonzero, in which case the image ofrc under the above 
bijection is the restriction of Owy to SO(V). 
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Proof. We give a sketch of the proof of Theorem 111.11 when k is non-archimedean. The 
reader will not find Theorem 111.11 in the reference [KR] , so let us explain how it follows 
from the results there (plus a little extra work). There are 2 isomorphism classes of 
quadratic space of dimension 2n + 1 and trivial discriminant; we denote these by V 
and V, and assume that V is split. To simplify notation, we shall write G in place of 
Qw,v,ip and 9' in place of Qw,v',tp- 

We now divide the proof into two steps: 

(i) Given an irreducible representation tt of Sp(iy), exactly one of 0(7r) or ©'(tt) is 
nonzero. 

This assertion was also shown in a recent preprint of C. Zorn [Z]. In any case, [KR, 
Thm. 3.8] shows that any irreducible representation n of Sp(iy) participates in theta 
correspondence with at most one of O(V^) or 0(V^'). We claim however that tt does 
have nonzero theta lift to O(V^) or 0{V'). To see this, note that [KR, Prop. 4.1] shows 
that TT has nonzero theta lift to 0{V) if and only if 

where RiV) is the big theta lift of the trivial representation of OiV) to Sp(l^ + W~) 
(where W~ is the symplectic space obtained from W by scaling its form by — 1). 
Similarly, one has the analogous statement for V. On the other hand, if Ip{s) denotes 
the degenerate principal series representation of Sp(iy + W~) unitarily induced from 
the character Xip ' I det l'^ of a Siegel parabolic subgroup, then one can show that 

Ip{0)=R{V)(BR{V'), 

so that R{V) and R{V') are unitarizable and thus irreducible (since they have a unique 
irreducible quotient). In particular, we conclude that vf has nonzero theta lift to one 
of 0(V") or 0{V') if and only if 

Homgp(^),s~(^)(/p(0),iKi^)^0. 

We thus need to show that this Hom space is nonzero. This can be achieved by the 
doubling method of Piatetski-Shapiro and Rallis [GPSR], which provides a zeta integral 

Z{s) : Ip{s)0n0^'^ — > C. 

The precise definition of Z{s) need not concern us here; it suffices to note that for a 
fiat section $(s) G Ip{s) and / G tt ® tt^, Z(s, $(s), / <S) /^) is a meromorphic 
function in s. Moreover, at any s = Sq, the leading term of the Laurent expansion of 
Z{s) gives a nonzero element 

Z*{so) G Homg^(^^^g^(^^(/p(so),iK^^). 

This proves our contention that vf participates in the theta correspondence with exactly 
one ofO{V) or 0{V'). 
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By (i), one obtains a map 

|irreducible genuine representations tt of Sp(VF)| 

]J {irreducible representations a' of 0(1^')} 

Moreover, this map is injective by the theorem of Waldspurger [Wa3] proving Howe's 
conjecture. 

(ii) An irreducible representation ttq of SO(y) has two extensions to 0(y) = SO(y) x 
(±1), and exactly one of these extensions participates in the theta correspondence with 
Sp(VF). The same assertion holds for representations of SO(y). 

Suppose on the contrary that tt is an irreducible representation of 0(y) such that 
both TT and tt ® det participate in theta correspondence with Sp(H^), say 

TT = ^(tt) and tt' = ^(tt (8) det). 

Now consider the seesaw diagram: 

%{yv + W-) o(y) X o(y) 



Sp(i^) X Sp(w^) oiy). 

The seesaw identity implies that 

Homg^^^^^g^^^^(ei^+iy-,y,V,(det), tt' KI tt^) D Homo(y)((7r (g) det) ® tt^, det) ^ 0. 
This imphes that 

6ty+vi/-,y,v>(det) 7^ 0. 

However, a classical result of Rallis [R, Appendix] says that the determinant character 
of Oiy") does not participate in the theta correspondence with Sp(4r) for r < n. This 
gives the desired contradiction. 

We have thus shown that at most one of tt or tt (8) det could have nonzero theta hft 
to Sp(VF). On the other hand, the analog of the zeta integral argument in (i) shows 
that one of tt or tt (8) det does lift to Sp(2n). This proves (ii). 

Putting (i) and (ii) together, we have established the theorem. □ 
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The only reason for the assumption of odd residue characteristic in the theorem 
is that Howe's conjecture for local theta correspondence is only known under this 
assumption. 

Since SO(V^) is an adjoint group, there is a unique orbit of generic characters, and the 
Vogan parameterization of irreducible representations a' of the groups SO(V^') requires 
no further choices. So we label tt = 7r(M, x) using the Vogan parameters (M, x) of the 
representation o' = Qw,V',ip{t^)- The theorem thus gives the following corollary. 

Corollary 11.2. Assume that the residue characteristic of k is odd. Suppose that the 
local Langlands- Vogan parameterization holds for SO(y). Then one has a parameter- 
ization ( depending on ip) of 

{irreducible genuine representations tt ofSp{W)} 
by the set of isomorphism classes of pairs {if, x) such that 

ip : WD — > Sp(M) 

is a symplectic representation of WD andx is an irreducible character of the component 
group A^. 

It follows that the various desiderata for the Vogan packets of Sp(iy) can be obtained 
from those of SO(y) if one understands the properties of the theta correspondence. 
For example, in the theta correspondence, generic representations of the split group 
SO(V^) lift to ^^-generic representations of Sp(W^). Hence the ^-generic element in the 
L-packet of M corresponds to the trivial character of the component group Am- Also, 
when k is non-archimedean, Tr{M,x) is lifted from the split group SO(y) precisely 
when x(— 1) = 1. 

One difference between metaplectic and linear groups is in the description of the 
action of the adjoint group by outer automorphisms on the set of irreducible represen- 
tations. The adjoint action of the symplectic simihtude group GSp(VF) on the set of 
genuine irreducible representations of Sp(VF) factors through the quotient 

^x/^x2 _ pSp(iy)(A;)/Image Sp{W){k). 

In the metaplectic case, this outer action does not permute the representations n in an 
individual Vogan L-packet, and we predict a more complicated recipe, as follows. 

Conjecture 11.3. //tt has ip-parameter {M,x) and c is a class in k^/k^^, the con- 
jugated representation has ip-parameter (M(c),x ■ ri[c]). Here M(c) is the twist of 
M by the one- dimensional orthogonal representation C(c) so that its component group 
Am{C) is canonically isomorphic to Am- The character r)[c] is defined by 

V[c] ^Xn-Am^ (±1), 
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where N is the two dimensional orthogonal representation N = C + C{c) , so that 

r)[c]{a) = e(M«) • e(M(c)») • (c, -i)^dimM'^_ 



This conjecture is known when dim W = 2, where it is a result of Waldspurger ([Wl] 
and [W2]); our recipe above is suggested by his results. 

The above conjecture has the following consequence. If one replaces the character ip 
by the character 

of /c, then the new Vogan parameter (relative to V^c) of tt will be (M(c), x • ^[c])- 
A consequence of this is the following. Suppose that tt is such that 

(^w,v,-4>{t^) 7^ and 9wy,i,X^) 7^ 

as representations of S0(\^). Then, when dimH^ = 2, a basic result of Waldspurger 
says that 

where Xc is the character 

^0{y){k) iEl!^21=. k^/k-^ ±1^1 (±1). 

However, according to the conjecture above, if the Vogan parameter of Ow.vipi'^) is 
(M, x), then that of 0w,v,ipc{^) ® Xc is iM,x ■ vi'^])- So the two representations are 
equal if and only if the character r][c\ is trivial. The assumption that tt has nonzero 
theta lift to SO(V^) with respect to both ip and ipc implies that 

V[c]{-l) = l. 

When dim W = 2, this is equivalent to saying that 77 [c] is trivial. But when dim W > 2, 
this is no longer the case and one can construct such counterexamples already when 
dim W = 4:. 

Another way of saying the above is that if the Langlands- Vogan parameter of a 
representation a of SO{V){k) is (M, x), then (M(c), x) is the parameter of a Xc and 
under the t/'-theta correspondence, cr Xc should be paired with an element in the 
Vogan packet of tt'^, but not necessarily to that specific representation. 
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12. The representation u of H and generic data 

In this section, we shall describe the remaining ingredient in the restriction problem 
to be studied. Suppose as before that is a local field with an involution a (possibly 
trivial) and ko is the fixed field of a. Let be a fc-vector space endowed with a non- 
degenerate sesquilinear form (— , — ) with sign e. Moreover, suppose that W G V is a. 
non-degenerate subspace satisfying: 

(1) e - (-l)dimW/^ = _l 

(2) W-^ is a split space. 

odd, if e = 1, i.e. V is orthogonal or hermitian; 
even, if e = — 1, i.e. V is symplectic or skew-hermit ian. 

Let G{V) be the identity component of the automorphism group of V and G{W) C 
G{V) the subgroup which acts as identity on W-^. Set 

G = G{V) X G{W). 

As explained in Section [2], G contains a subgroup H defined as follows. Since W-^ is 
split, we may write 

W^ = X + X'' or = X + X"^ + E 

depending on whether dimVT^ is even or odd, where in the latter case, ii^ is a non- 
isotropic line. Let P be a parabolic subgroup which stabilizes a complete fiag of 
(isotropic) subspaces in X. Then G(W) is a subgroup of a Levi subgroup of P and 
thus acts by conjugation on the unipotent radical of P. We set 

H = N G{W). 

Note that there is a natural embedding H "-^ G which is the natural inclusion 

H CPC G{V) 
in the first factor and is given by the projection 

H — > H/N = G{W) 

in the second factor. When G' = GiV') x G{W') is a relevant pure inner form of G, a 
similar construction gives a distinguished subgroup H'. 

The goal of this section is to describe a distinguished representation u oi H (and 
similarly H'). It will turn out that dimz/ = 1 if dimVT^ is odd (orthogonal and 
hermitian cases), whereas u has Gelfand-Kirillov dimension 1/2 • dim(14^//co) when 
dim W-^ is even (symplectic and skew-hermitian cases) . Because of this, we will treat 
the cases when dim W-^ is even or odd separately. 



So we have 

dim = 
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Orthogonal and Hermitian Cases (Bessel Models) 



Assume that dim W — 2n + 1 and write 

W^^X + X'^ + E with E^{e), 

where X and are maximal isotropic subspaccs which are in duality using the form 
(— , — ) of V, and e is a non-isotropic vector. Let P{X) be the parabolic subgroup in 
G{V) stabilizing the subspace X, and let M{X) be the Levi subgroup of P{X) which 
stabihzes both X and X^ , so that 

M{X) = GL(X) X G{W © E). 

We have 

P{X) = M{X) K N{X) 

where N{X) is the unipotent radical of P{X). The group N{X) sits in an exact 
sequence of M(X)-modules, 

> Z{X) > N{X) > N{X)/Z{X) > 0, 

and using the form on V , one has natural isomorphisms 

Z[X) = {skew-hermitian forms on X^}, 

and 

N{X) /Z{X) ^ Hom(W^ + E,X)^{W + E)® X. 

Here, when k = ko, skew-hermitian forms on X^ simply mean symplectic forms. In 
particular, Z{X) is the center of N{X) unless k = ko and dimX = 1, in which case 
Z{X) is trivial and N{X) is abehan. 

Now let 

be a nonzero /c-linear homomorphism, and let 

ew--w®E — >k 

be a nonzero /c-linear homomorphism which is zero on the hyperplane W. Together, 
these give a map 

ix^iw:X^{W + E) — >k, 
and one can consider the composite map 

e^ix) : N{X) > N{X)/Z{X) ^ X ® {W + E) k. 

Let Ux be any maximal unipotent subgroup of GL{X) which stabilizes Ix- Then the 
subgroup 

Ux X GiW) C M{X) 

fixes the homomorphism iN{x)- 
Now the subgroup 

H dO^ G{V) X G{W) 
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is given by 

H = {N{X) X {Ux ■ G{W)) ^Nx G{W). 

We may extend the map £n{x) of N{X) to H, by making it trivial on Ux x G{W). If 
■0 is a non-trivial additive character of k, and 

Xx-.Ux^ 

is a generic character of Ux, then the representation 1/ oi H is defined by 

U= (V'o£jv{X)) ^\x- 

The pair (if, is uniquely determined up to conjugacy in the group G = G{V) x G{W) 
by the pair W dV. 

One can give a more explicit description of (if, u), by explicating the choices of ix, 
Ux and Ax above. To do this, choose a basis {vi, • • • , Vn} of X, with dual basis {f •} 
of X^. Let P C G'(y) be the parabohc subgroup which stabihzes the flag 

C (vi) C {Vi, V2) (Z ■■■ (Z {vi, ■■■ ,Vn) ^ X, 

and let 

L= (A;^)" X G{W + E) 

be the Levi subgroup of P which stabihzes the hues (vi) as well as the subspace W + E. 
The torus T — (/c^)" scales these hues: 

t{Vi) = tiVi, 

and G{W + E) acts trivially. 

Let N be the unipotent radical of P, so that 

N = Ux^ N{X) 

where Ux is the unipotent radical of the Borel subgroup in GL(X) stabilizing the 
chosen flag above. Now define a homomorphism f : N ^ fc" by 

f{u) = {xi, ■ ■ ■ ,Xn-i,z), 

Xi = {uvi+i,vl), i = 1,2, ■ ■ • ,n - 1 
z = {ue,v'„). 

The subgroup of L which fixes / is G{W), the subgroup of G{W + E) fixing the vector 
e. The torus acts on / by 

f{tur^) = {tl/hx^, tl/hx2, ■■■ , t^z). 

Consider the subgroup H = N.G{W) of G = G{V) x G{W). Then, for a non-trivial 
additive character ip of k, the representation 1/ is given by: 

u : H^C" 

(u,g) ^ ijj(J2xi + ^)- 
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It is as regular as possible on N, among the characters fixed by G{W). As noted above, 
up to G-conjugacy, the pair {H, i/) depends only on the initial data W (Z V, and not 
on the choices oi ip, {vi}, or e used to define it. 

A special case of {H, v) is worth noting. If V is orthogonal of even dimension and 
W has dimension 1, then SO(W^) = 1 and H — N is the unipotent radical of a Borel 
subgroup P C G — SO{V). In this case, u is simply a generic character 9w of A^. By 

choosing different non-isotropic lines L in the 2-dimensional orthogonal space W + E, 
so that L"*- = X + X"^ + L', and using L in place of W in the above construction, the 
map L 9l gives a bijection 

{T-orbits of generic characters on N} 

{SO(y)-orbits of non-isotropic fines L with split} 
in the even orthogonal case. 

Symplectic and Skew-Hermitian Cases (Fourier-Jacobi Models) 

We now treat the symplectic and skew-hermitian cases, so that W-^ is spfit of even 
dimension 2n and we may write 

where X and X^ are maximal isotropic subspaces which are in duality using the form 

on V. In this case, G{W) is a subgroup of Sp(W^/A:o), preserving the form TYk/k()°{—, —)■ 
It will turn out that the representation u of H depends on some other auxiliary data 
besides the spaces W G V. As in the case of Bessel models, we include the case 
in our discussion below. 

We assume first that dim AT > 0. Let P{X) = M{X) ■ N{X) be the parabolic 
subgroup in G{W) stabilizing the subspace X, with Levi subgroup 

M{X) = GL(X) X G{W) 

stabilizing both X and X^. Let Z[X) be the center of the unipotent radical N[X) of 
P{X), so that one has the exact sequence of M(X)-modules: 

> Z{X) > N{X) > N{X)/Z{X) > 0, 

Using the form on F, one has natural isomorphisms 

Z[X) = {hermitian forms on X^} 

and 

N{X) /Z{X) ^ Hom(iy, X)^W ®X. 
Here, \i k — k^, then hermitian forms on X^ simply mean symmetric bilinear forms. 



RESTRICTION PROBLEMS FOR CLASSICAL GROUPS 47 
The commutator map 

[-, -] : N{X) X N{X) N{X) 

factors through N{X)/Z{X) and takes value in Z{X). It thus gives rise to a skew- 
symmetric /co-bihnear map 

Al^(X 0W) — > Z{X) = {hermitian forms on X^}, 

or equivalently by duahty, a map 

{hermitian forms on X} — > A^^(X'^ ® W) = {symplectic forms on ReSfc/feo(X ® W)}. 

Indeed, this last map is a reflection of the fact that, using the skew-hermitian structure 
on W , the space of hermitian forms on X can be naturally embedded in the space of 
skew-hermitian forms on X ® W , and then by composition with the trace map if 
necessary, in the space of symplectic forms on ReSfe/fcp(X ® W). 

Now let 

Ix-.X^k 

be a nonzero homomorphism, and let Ux C GL(X) be a maximal unipotent subgroup 
which fixes ix- Then the group H is defined by 

H = N{X) X {Ux X G{W)) = AT X G{W) 

with N = N{X) xUx- li 

\x:Ux^ 

is a generic character of Ux, then by composing with the projection from H to Ux-, we 
may regard Ax as a character of H. 

On the other hand, by puUinag back, the homomorphism Ix gives rise to a linear 
map 

/co = {hermitian forms on k} — > {hermitian forms on X}, 
and hence by duality 

^z{x) '■ Z{X) = (hermitian forms on X^} — > ko. 

Moreover, ix gives a /c-linear map 

£w ■■ X ®W 
making the following diagram commute: 

Aio(^®^) ^ Z{X) 
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For example, when k = ko and dimX = 1, then the commutator map [— , — ] is given 
by the skew-symmetric form 2 • (— , —)iy on N{X)/Z{X) — W. On the other hand, 
when k ko and dimX = 1. it is given by the skew-symmetric form Trfe/jk(j((— , —)w) 
on W/Uq. In any case, let us set 

J the quadratic space with discriminant 1, ilk — k^, 
I the hermitian space of discriminant 1 ii k ko, 

and let H{Vi (8) W) be the Heisenberg group associated to the symplectic vector space 
Vi<SiW over ko with form 

Trk/ko({-, -)vi ® (-, -)w)- 
Here, given a quadratic space (V, q) over ko, the associated symmetric bilinear form is 

{vi,V2) = q{vi + V2) - q{vi) - q{v2). 

Thus, when k = ko, the form on Vi is such that {v, v)v = 2, so that H{Vi ® W) is the 
Heisenberg group associated to the symplectic vector space {W, 2 ■ {—,—)^r)■ 
Now one has the following commutative diagram of algebraic groups over ko'- 

^ Z{X) ^ N{X) ^ X^W ^ 

> ko > H{Vi ® W) > W > 0. 

Given a nontrivial character ip : ko ^ Ei^, one may consider the unique irreducible 
unitarizablc representation ujw4i of HiVi ® W) of GK-dimcnsion | • dim^g W, on which 
the center of H{Vi W) acts by ip. Pulling back by the above diagram, one obtains 
an irreducible representation of N{X) with central character ip o iz{x)- Up to 
conjugation by M{X), the representation uj^ depends only on up to multiplication by 
^^x'^i+o- rpj^g representation co^ can be extended trivially to Ux- Moreover, the group 
G{W) acts as outer automorphisms of H{Vi®W), so the theory of Weil representations 
furnishes us with a projective representation of G{W) on u;^. Thus, one has a projective 
representation uj^ of H. 

As in the orthogonal and hermitian cases, we can make the above discussion com- 
pletely explicit by making specific choices of £x, Ux and A^. Assuming that dimX = 
n > 0, choose a basis {vi} for X and let {v^} be the dual basis of X^. Let P C G{V) 
be the subgroup stabihzing the flag 

C C ••• C ,Vn) C X, 

and let 

L^G{W) X (A;^)" 
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be the Levi subgroup of P stabilizing the hues (vi) as well as the subspace W. 

Let N be the unipotent radical of P and define a homomorphism to a vector group 

f -.N ^ k^-^ e W 

given by: 

f{u) = {xi,--- ,Xn-uy) 
Xi = {uvi+i,v'^ 

Here {wi, • • • ,Wn} is a basis for W over k and {wi,Wj) = 6ij. Thus y is the unique 
vector in W with 

{w,y) = {uw,v'^) 

for all winW. 

The torus T = (A;^)" acts on / by 

and an element g e G'(l^) acts by 

Now the maps (xi, • • • , Xn~i) give a functional 

n 1-^ Tr(^ Xi) 

which is fixed by G{W), and is as regular as possible subject to this condition. Choose 
a nontrivial additive character ip of ko. Then the character 

A : Ar->§i 

is regular, and up to conjugacy by the torus, independent of the choice of ip. Since it 
is fixed by G{W), we may extend it trivially to G{W) and obtain a character A of H. 

On the other hand, one may define a homomorphism of to a Heisenberg group as 
follows. Let Nq < N he the kernel of the map 

N 

u I— > y 

and define a homomorphism 

/o : N^^k 

uo^ {uov'^,v!J. 

Note that the element z lies in the subfield ko of /c, since 

uovl^ is isotropic =^ z — z'^ — 0. 
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Hence, we have 
The torus act by 

and G{W) acts triviaUy. The above two maps combine to give a homomorphism from 
N to the Heisenberg group H{W/ko): 

> No > N > W > 

> ko > H{Vi ® W) > W > 

which is equivariant for the action of G(W) on N and G(W) C Sp(Vi W) on H{Vi ® 
W). The non-trivial additive character tjj then gives rise to the projective representation 
cj^ oi H as above. 

It is now more convenient to consider the symplectic and skew-hermitian cases sep- 
arately. 

(i) (symplectic case) When k = ko, we have G{W) = Sp{W). In this case, it is 
known that the projective representation uj^ of G{W) lifts to a linear represen- 
tation of the double cover G{W) — Sp(l^), the metaplectic group. RecaUing 
that 

H ^ N >^G{W), 
we thus obtain a unitary representation 

i/^ = o;^ (g) A 

of 

H^N X G(W) 
in the case when diml^-*- > 0. 

When = 0, so that W ^V,we have 

A^={1} and H ^G{W) = G{V). 
In this case, we simply set 

J^ip = ^ipt 

which is a representation of H . 

In each case, the representation has GK-dimension 1/2 • dmiiW/ko). Up 
to conjugation by the normalizer of H in G, depends only on -0 up to the 
action of {k'^y. 
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A particular case of this is worth noting. When W = 0, so that G{W) is 
trivial, the group H is simply the unipotent radical N of the Borel subgroup P 
and is simply a generic character of N. This gives a bijection 

{T-orbits of generic characters of N} 

{/c^ ^-orbits of nontrivial characters t/j oi k} 
in the symplectic case. 

(ii) (skew-hermitian case) When k ^ ko, G{W) = U(Vr). In this case, the projective 
representation of G{W) = 1]{W) lifts to a linear representation of G{W), 
but when dimPF > 0, the lifting is not unique: it requires the choice of a 
character 

whose restriction to k^ is the quadratic character cj^./^.„ associated to k/ko 
[HKS]. Equivalently, when /c is a field, it requires the choice of a 1-dimensional, 
conjugate-dual representation of WDj. with sign c = —1. Given such a /i, we 
let Lo^^fj, be the corresponding representation of G{W) and set 

Hence, we have defined an irreducible unitary representation u^^^ oi H — 
N.UiW) when dimW^ > 0. 

When W-^ — 0, so that = V^, we have 

N^{1} and H ^G{W)^G{V). 
In this case, we simply set 

In each case, the representation i/^^^ has GK-dimension 1/2 • dim(W^/A;o)- It 
depends, up to conjugation by the normalizer of if in G = U(l^) x U(H^), on 
ip up to the action of Nk^ (as well as the choice of /i). 

A particular case of this is noteworthy. When W = (and V is even dimen- 
sional), so that G{W) is trivial, the group H is simply the unipotent radical N 
of the Borel subgroup P and there is no need to choose /i. Hence, u^^^ = is 
simply a generic character of N. This gives a bijection 
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{T-orbits of generic characters of N} 

{Nfc^ -orbits of nontrivial characters of ko} 
in the even skew-hermitian case. 

Remarks: Note that when W = 0, there is no need to invoke the Weil rep- 
resentation at all. Hence, the above description of generic characters could be 
carried out for hermitian spaces (of even dimension 2n) as well. One would 
consider the situation 

W = G V of hermitian spaces. 

and note that the homomorphisms 

/ : — > fc"-^ 

and 

fo:N = No^k 

can still be defined by the same formulas. But now the image of /o lies in 
the subspace of trace zero elements of k (as opposed to the subfield ko when 
V is skew-hermitian). The torus actions on / and /o are again given by the 
same formulas. Thus, giving a T-orbit of generic characters of in the even 
hermitian case amounts to giving a nontrivial character of k trivial on ko, up 
to the action of Nk^ . 

This completes our definition of the representation u of H. 

As we noted in the course of the discussion above, special cases of the pair {H, v) 
give the determination of T-orbits of generic characters. Recall that if G = G{y) is 
quasi-split, with Borel subgroup B = T ■ N, then the set D of T{ko)-oThits of generic 
characters of A^ is a principal homogeneous space for the abelian group 

E = T^'^ik) /Im T{k) = keT{H\k,Z) H\k,T)). 

When G = GL{V) or V{V) with dim^ odd or SO{V) with dimV" odd or dimV" = 2, 
the group E is trivial. In the remaining cases, E is a finite elementary abelian 2-group. 
In Section [TOl we have described the i?-torsor D explicitly for the various classical 
groups G{V), but did not say how this was done. Our discussion of {H, u) above has 
thus filled this gap, and we record the result in the following proposition for ease of 
reference. 



RESTRICTION PROBLEMS FOR CLASSICAL GROUPS 53 

Proposition 12.1. (1) If V is symplectic, E = k^/k^"^, and we have a bijection 
of E-spaces 

D < — fc^^ — orbits on nontrivial il) : k ^ . 

(2) IfV is hermitian of even dimension, E = kQ /Nk^ , and we have a bijection of 
E-spaces 

D < — > Nk^ — orbits on nontrivial i/j : k/ko ^ C 

(3) IfV is skew-hermitian of even dimension, E = k^ /Nk^ , and we have a bijection 
of E-spaces 

D i — > Nfc^ — orbits on nontrivial i(j : ko ^ 

(4) IfV is orthogonal of even dimension and split by the quadratic algebra K, then 
E = NK^ /k^"^, and we have a bijection of E-spaces 

D i — > SO(V") — orbits on non — isotropic lines L C V, with split. 



13. Bessel and Fourier- Jacobi models for GL(n) 

The construction of the pair {H, v) given in the previous section includes the case 
when k = ko X ko is the split quadratic algebra. In this case, the groups GiV) and 
G(W) are general linear groups, and it is useful to give a direct construction of {H, v) 
in the context of general linear groups, rather than regarding them as unitary groups 
of hermitian or skew-hermitian spaces over k. We describe this direct construction in 
this section. 

We first give a brief explanation of how one translates from the context of unitary 
groups to that of general linear groups. The hermitian or skew-hermitian space V has 
the form 

y = Vb X V^ 

for a vector space Vq over k^. Moreover, up to isomorphism, the hermitian form on V 
can be taken to be 

((x,x^),(y,y^)) = ((x,y^),(y,x^))eA;, 
whereas the skew-hermitian form on V can be taken to be 

((x, x^), {y, y^)) = {{x, y^), -{y, x"^)) G k. 
Then, by restriction to to Vq, one has an isomorphism 

G{V)^GL{Vo). 

If C is a nondegenerate subspace, then W = Wq x Wq gives rise to Wq C Vq. 
If, further, W-^ is spht, and X C W-^ is a maximal isotropic subspace, then X has the 
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form 

with the natural pairing of Xq and Yq equal to zero, so that Xq is contained in the 
kernel of Y^^ . Writing the kernel of Y^ as Xq + Wq, we see that the isotropic space X 
determines a decomposition 

Vo = Xo + Wo + Yo, 

with a natural perfect pairing between Yq and Y^ . Then the parabolic subgroup P{X) 
stabilizing X in G{V) is isomorphic to the parabolic subgroup of GL(Vo) stabilizing 
the flag 

XoCXo + WoGVo. 

It is now easy to translate the construction of {H, v) given in the previous section to 
the setting of Wq C Vq, and we simply describe the answer below. 

Bessel Models for GL(n) 

In this case, we start with a vector space Vq over ko with a decomposition 

Vo = Xo + Wo + Eo + X^, 

where Eq = (e) is a line. Consider the (non-maximal) parabolic subgroup Q stabilizing 
the flag 

XoCXo + Wo + EoG Vo- 
lt has Levi subgroup 

L = GL(Xo) X GL{Wo + ^o) x GL(Xo^) 
and unipotent radical U sitting in the exact sequence: 

> Hom(Xo^, Xo) > U > Hom(Xo^, Wo + Eq) + Hom(W^o + Eq, Xo) > 0. 

We may write the above exact sequence as: 

> Xo ® Xo > U > Xo ® {Wo + Eo) + (W^ + E^) (g) Xo > 0, 

where E^ — (/) is the dual of Eo- 

Let 

£xo '■ Xo — > ko 

be any non-trivial homomorphism, and let Uxq x Ux^ be a maximal unipotent subgroup 
of GL{Xo) X GL{Xq) which fixes £xo- On the other hand, let 

iwo : {Wo + Eo) + {W^ + E^) ko 

be a linear form which is trivial on Wq + Wq but non-trivial on Eq and Eq . Together, 
the homomorphisms £xo and give a map 

£^£xo®^Wo-U ^Xo^ {Wo + Eo) + {W^ + E^) (8) Xo ^ A;o. 
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Since £ is fixed by Uxq x Ux^ x GL(11/o), we may extend i trivially to this group. Thus, 
we may regard ^ as a map on 

H = U>i{{Ux, X Ux-) X GL{Wo)). 

Choose any non-trivial additive character ip of /cq and any generic character 

A : f/xo X Ux- S\ 

which we may regard as a character of H. Then the representation 1/ of H is defined 

by 

i/ = o £) A. 

The pair {H, v) depends only on the spaces Wq C Vq, up to conjugacy by GL(Vo)- This 
completes the construction of {H, v) in the case when codimWo is odd. 

Fourier-Jacobi models for GL{n) 

In this case, we consider a vector space Vq over /cq, together with a decomposition 

As before, let Q be the parabolic subgroup stabihzing the flag 

X^dX^ + WodVo. 

Thus Q has Levi subgroup 

L = GL(Xo) X GL(Wo) x Gh{X^), 

and its unipotent radical U sits in the exact sequence, 

^ Hom(Xo^, Xq)^U ^ Hom(Xo^, Wq) + Hom(Wo, Xq) 0, 

in which Hom(XQ ,Xo) is central. The group U is completely described by the natural 
bilinear map 

Hom(Xo^, Wo) X Hom(Wo,Xo) ^ }lom.{X^ , Xq) . 
Indeed, given a bilinear map 

(-,-) :5xC^ A 

of vector groups, there is a natural central extension of S x C by A defined by a group 
structure on Ax B x C given by 

(ai, 61, ci)(a2, 62, C2) = (oi + a2 + (61, C2), 61 + 62, ci + C2). 
Given a linear map 

let 

C/xo X C/xv C GL(Xo) X GLiX^), 
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be a maximal unipotent subgroup fixing ixo- Let 

A : t/xo X t/xv 

be a generic character, which we may regard as a character of 

H = U^{Ux,^ Ux- X GL{Wo)) 

via projection onto Uxq x Ux^ ■ 

On the other hand, the homomorphism £xo allows one to define a homomorphism 
from U to the Heisenberg group H{Wo + Wq): 

> Xq^Xq > U > ^Xo + Xo^Wo > 

> ko > H(W^ + Wo) > + Wo > 0, 

which is clearly equivariant under the action of Uxq x Ux^ x GL(iyo)- 

Thus, given any non-trivial additive character of /cq, we may consider the unique 
irreducible representation of H{Wq + Wq) with central character ip, and regard it as 
a representation of U using the above diagram. This representation can be extended 
trivially to Uxo x Ux^, and is realized naturally on the space S{Wo) of Sxhwarz- 
Bruhat functions on Wq. For any character fj, : — C^, one then obtains a Weil 
representation cu^^fj, of 

H = (GL(W^o) X Uxo X Uxv) k U. 
on S{Wo), where the action of GL(iyo) is given by 

{g-f)(w)^l,(det(g))-f(g~'.w). 

When dimXo > 0, the representation 1/^^^ of H is then given by 

When dimXo = 0, we have Wq = Vq and we take the representation u^^^ oi H = 
GL(Wo) to be the representation u^^^ of GL(iyo) on S{Wq) defined above. In either 
case, the isomorphism class of uj^^^ is independent of ip and the pair {H, V'tp^^) is inde- 
pendent of i/j, up to conjugacy in GL(Vo). This completes the definition of {H, u) when 
codimFFo is even. 

This concludes our direct construction of the pair {H, /i) for general linear groups. 
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14. Restriction Problems and Multiplicity One Theorems 
We are now ready to formulate the local restriction problems studied in this paper. 

Let W (Z V be as in gni so that G = G{V) x G{W) contains the subgroup H = 
N X G{W). We have defined a representation v oi H (or its double cover), which may 
depend on some auxiliary data such as ijj or /x. Let vr = vry IE nw be an irreducible 
representation of G (or an appropriate double cover). Then the restriction problem of 
interest is to determine 

dime Homi^(7r (g) z7, C). 

More precisely, we have: 

(1) In the orthogonal or hermitian cases, the representation v oi H depends only 
onW <ZV and so we set 

(i(7r) = dime Homj|/(7r ® 77, C) = dime Homi^(7r, z/). 

In the literature, this restriction problem is usually referred to as a problem 
about the existence of Bessel models. Indeed, for an irreducible representation 
TT = TTyKlvri^ of G, the space Homff(7r, z/) is usually called the space of vTy^-Bessel 
models of ny. 

(2) In the symplectic case, the representation i/^ is a representation of the double 

cover H = N y\ Sp(Vr) and depends on a nontrivial additive character ip of 
fc = /cq up to the action of A;^^. In this case, for the above Hom space to be 
nonzero, the representation tt = Try Kl ttw must be a genuine representation 
when restricted to H. Hence, we have to take an irreducible representation 

?F = TTy K ^VK of Sp(r) X Sp(H^) 

or 

li = nv^T^w of Sp(V) X Sp(Vr). 
In this case, we set 

(i(7f, ip) = dime Hom^(7f ® z7^, C). 

In the literature, this restriction problem is usually referred to as one about 
Fourier- Jacobi models. Indeed, the space Hom^(7r (g) z7^, C) is usually called the 
^/')-Fourier- Jacobi models of vry. 

(3) In the skew-hermitian case, the representation z/^^^ of H depends on a nontrivial 
additive character ip of ko, up to the action of N/c^, and also on the choice of a 
character fi of whose restriction to k^ is the quadratic character associated 
to k/kQ. In this case, we set 

d{7i, n, ijj) = dime Romnin (g) 77^,/,, C). 
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In the literature, this restriction problem is usually referred to as a problem 
about the existence of Fourier- Jacobi models in the context of unitary groups. 
Indeed, the space Hom^(7r I^v,,/^, C) is usually called the (tt^, ■0, //)-Fourier- 
Jacobi models of Try. 

We remark that in the orthogonal and hermitian cases, since u is 1-dimensional and 
unitary, one has: 

Homi/(7r (g) 17, C) ^ Homjj(7r ® , C) ^ Homjj(7r, v). 

In the symplectic and skew-hermitian cases over non-archimedean fields, the same 
assertion holds, even though u is infinite-dimensional. However, over archimedean 
fields, it is only clear to us that: 

Homif(7r, v) C Homij(7r (g) , C) = Homij(7r (g) 17, C). 

The difficulty arises in the subtlety of duality in the theory of topological vector spaces. 
In any case, we work with Homj|/(7r(g)I7, C) since this is the space which naturally arises 
in the global setting. We should also mention that, over archimedean fields, the tensor 
product TT (g) 17 refers to the natural completed tensor product of the two spaces (which 
are nuclear Prechet spaces) and Hom(— , C) refers to continuous linear functionals. For 
a discussion of these archimedean issues, see [AG, Appendix A]. 

A basic conjecture in the subject is the assertion that 

diir) < 1 

in the various cases. Recently, there has been much progress in the most basic cases 
where dimiy-*- or 1. We describe these in the following theorem. 

Theorem 14.1. Assume that dim 14^-*- = or 1. 

(i) In the orthogonal case, with G = OiV) x 0(1^), we have 

d{n) < 1. 

(ii) In the hermitian case (including the case when k — kg x kg), we have 

d{7r) < 1. 

(Hi) In the symplectic case, suppose that k is non-archimedean. Then we have 

d{7r,i/j) < 1. 

(iv) In the skew-hermitian case (including the case k — ko x ko), suppose that k is 
non-archimedean and that tt — iry ^ 'Kw with at least one of Try or ttw supercuspidal. 
Then we have 

d^K.ji.ip) < 1. 
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Proof. The cases (i) and (ii) are due to Aizenbud-Gourevitch-Rallis-Schiffmann [AGRS] 
in the p-adic case and to Sun-Zhu [SZ] and Aizenbud-Gourevitch [AG] in the archimedean 
case. The case (iii) is a result of Sun [S] in the non-archimedean case (the archimedean 
case seems to be still open). The methods of [S] could likely be adapted to give (iv) 
completely in the non-archimedean case. However, we shall show how (iv) can also be 
deduced from (ii) using theta correspondence. 

Thus, suppose that W is a skew-hermitian space and tti and tt2 are irreducible 
representations of U(iy) with 7r2 supercuspidal. For a hermitian space V of the same 
dimension as W, one may consider the theta lifting between U(iy) and U(l^), with 
respect to the fixed additive character ip and the fixed character fi. By [HKS], there is 
a (unique) V such that the theta lift of vri to U(V^) is nonzero; in other words, there is 
an irreducible representation r of U(y) such that 0^,;i(r) has tti as a quotient. Now 
consider the seesaw diagram 

V{W)xV{W) U(r ©(-!)) 



\J{W) \J{V) X U((-l)). 

The resulting seesaw identity gives 

d{TTi Kl 7r2,/i, ■?/') = dimHomu(vy)(vri (^uJ:^,tc2) 

< dimHomu(iy)(6v.,At(i") (^uJ^, TC2) 
= dimHomu(y)(6^,^(7r^),r) 
= dimHomu(y)(6'^,^(vr2),r) 
<1, 

as desired. Here, we have used the assumption that H2 is supercuspidal to deduce that 
Qv'.m(^2 ) = ^il>,ti{'^2) is irreducible. 

The above seesaw argument works in the case when k = x kf) as, well, thus 
completing the proof of (iv). Indeed, this argument shows more generally that the 
multiplicity one results in (ii) and (iv) are equivalent, modulo the issue of whether 
0(r) = 9{t). Similarly, the analogous argument for symplectic-orthogonal dual pairs 
shows that the results of (i) and (iii) are equivalent, with the same caveat on versus 

e. □ 



Remarks: In the orthogonal case, it is still not known whether the multiplicity one 
result of Theorem 114.11 holds for special orthogonal groups, i.e. for G = SOiV) x 
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SO{W). It is expected but does not seem to follow from the result for orthogonal 
groups. 

15. Uniqueness of Bessel Models 

In this section, we show that if k is non-archimedean, the multiplicity one theorem 
for the general Bessel models can be deduced from Theorem 114. l( i) and (ii) in the 
orthogonal and hermitian cases. We remind the reader that the case k = ko x ko is 
included in our discussion. In particular, the results we state below are valid in this 
case as well, though we frequently write our proofs only for k a field, and leave the 
adaptation to the case k = ko x ko to the reader. Moreover, in the orthogonal case, 
we shall work with orthogonal groups, rather than special orthogonal groups, since 
Theorem 114.11 only applies to the former. 

Thus, we consider the case when W dV are orthogonal or hermitian spaces of odd 
CO dimension. Then we have 

= X + + E 
where E = k ■ e is a. non-isotropic line and 

X = {vi,V2, ■■■ ,Vn) 

is an isotropic subspace with dimX = n > and dual basis {v^} of X^. With 
G = G{V) X G{W) andH = N- G{W), we would like to show that 

dimHomH(7ry (g) ttw, z^) < 1 

for any irreducible representation vry Kl of G. 

Let 

E- = k-f 

denote the rank 1 space equipped with a form which is the negative of that on E, so 
that E + E~ is a split rank 2 space. The two isotropic lines in E + E~ are spanned by 

Vn+i=e + f and v'^^^ = — - ■ (e - /). 

2 ■ (e, e) 

Now consider the space 

W = V®E- 

which contains V with codimension 1 and isotropic subspaces 

Y = X + k- Vn+l = {Vi, - ■■ , Vn+l) 

and 

Y'' = X'' + k-v:,^, = {v[,---,v'^_,,). 

Hence we have 

W' = Y + Y'' + W. 
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Let P = P{Y) be the parabolic subgroup of G{W') stabilizing Y and let M be its Levi 
subgroup stabilizing Y and y^, so that 

M = GL(F) X G{W). 

Let r be a supercuspidal representation of GL(F) and ttw an irreducible representation 
of G{W) and let 

I{t,7Cw) =lndf^'\T^7iw) 

be the (unnormalized) induced representation ofG{W') from the representation tMttw 
of P. 

Our goal is is to prove the following theorem: 

Theorem 15.1. Assume that k is non-archimedean. With the notations as above, we 
have 

Hom(;(y)(/(T, TTw) <8) TTy, C) = Homij(7ry TTw, l^) 

as long as TTy does not belong to the Bernstein component of G{V) associated to 
(GL(y) X G{V'),T ® n), where Y' G V is isotropic of dimension equal to dimY 
with V — Y' + + V and (i is any irreducible representation of G{V'). 

Proof. We assume that A; is a field in the proof and calculate the restriction of 11 := 
J(r, TTpv') to G{V) by Mackey's orbit method. For this, we begin by observing that 
G{V) has at most two orbits on the flag variety G{W')/P{Y) consisting of: 

(1) n + 1-dimensional isotropic subspaces of W which are contained in V; these 
exist if and only if W is isotropic, in which case if Y' is a representative of this 
closed orbit, then its stabilizer in G{V) is the parabolic subgroup Pv{Y') ~ 
P{Y')nG{V); 

(2) n + 1-dimensional isotropic subspaces of W which are not contained in V; a 
representative of this open orbit is the space Y and its stabilizer in G{V) is the 
subgroup Q = P{Y) n G{V). 

By Mackey theory, this gives a filtration on the restriction of 11 to G{V) as follows: 

> mdQ^^\T ® 7rw)\Q > ^Giv) > lndp'^^l,^T ® 7rw\G(V') ^ 0, 

where the induction functors here are unnormalized. 

By our assumption, TTy does not appear as a quotient of the 3rd term of the above 
short exact sequence and we have 

HomG(y)(indQ^^V (g) 'Kw)\q, t^v) = HomG(y)(n, TTy). 
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It thus suffices to analyze the representations of G{V) which appear on the open orbit. 
For this, we need to determine the group Q — P{Y) fl G{V) as a subgroup of G{V) 
and P{Y). 

Recall that W ^Y®W®Y^, and V is the codimension 1 subspace X^W^X'^^E 
which is the orthogonal complement of /. It is not difficult to see that as a subgroup 
of G{V), 

Q = GiV)nPiY) C PviX). 

Indeed, if g & Q, then g fixes / and stabilizes Y, and we need to show that it stabilizes 
X. If a; e X, it suffices to show that {g ■ x , e — f) = 0. But 

{g ■ X ,e - f) = {x , g'^ ■ {e - f)) = {x , g'^ ■ Vn+i - 2/) = 0, 

as desired. 

Now we claim that as a subgroup of Pv{X), 

Q = (GL(X) X G{W)) K Nv{X), 

where Ny{X) is the unipotent radical of Pv{X). To see this, given an element h e 
Pv{X), note that h e Q if and only if 

h • Vn+i e Y, or equivalently h • e — e &Y. 

We may write 

h-e — X-e + w + x, with w G W and x & X. 

Then we see that h- e — e &Y if and only if A = 1 and w = 0, so that h fixes e modulo 
X and hence stabihzes W modulo X, in which case h G (GL(X) x G{W)) x Nv{X), 
as desired. 

Since we are restricting the representation r Kl nw of P{Y) to the subgroup Q, we 
also need to know how Q sits in P{Y). For this, we have: 

> N(Y) > P(Y) > GL(y) X G(W) > 

T T T 

> N{Y)nQ > Q > RxG{W) ^0 

where 

R C GL(y) 

is the mirabolic subgroup which stabilizes the subspace X (ZY and fixes Vn+i modulo 
X. Note also that N{Y) nQ G Nv{X) and 

NviX)/{N{Y) n g) ^ Rom{E,X). 
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As a consequence, one has: 

(r K tiw)\q = r\R K 7iw 

By a well-known result of Gelfand-Kazhdan, one knows that 

t\r ^ ind^x 

where U is the unipotent radical of the Borel subgroup of GL(F) stabilizing the flag 

(Vi) C {Vi, V2) C ■■■ C {Vi, ■■■ , Vn+l) = y, 

and X is any generic character of U. Now observe that the pre-image of [/ x G{W) in Q 
is precisely the subgroup H of G(y) and the representation x^t^w ofU x G(W) pulls 
back to the representation i/^ ® nw of H. Hence, by induction in stages, we conclude 
that 

indg^^^(r (g) 7ro)|Q = ind^^^V^y (g) u'^ . 
Thus, by dualizing and Frobenius reciprocity, one has 

HomG(y)(/(r,7rH/),7r^) = Hom/^(7ry (g) 7?^/, z/). 
This completes the proof of the theorem. □ 

Corollary 15.2. In the orthogonal or hermitian cases over a non-archimedean k, with 
W G V of odd codimension, we have 

dime Hom//(7r, u) < I 

for any irreducible representation vr o/G = G{V) x G{W). 

Proof. We apply the theorem with a choice of the supercuspidal representation r satis- 
fying the conditions of the theorem and such that the induced representation /(r, nw) 
is irreducible. □ 

Remarks: In the archimedean recent preprint of Jiang-Sun-Zhu [JSZ] uses an 

adaptation of the proof of Theorem 115.11 gives the containment 

RomniTTv ® ttw, ^) C HomG(y)(/('r, Ttw) ® t^v, C). 

Namely, to each element on the LHS, [JSZ] constructs an associated element on the 
RHS, using an explicit integral. This is enough to deduce the multiplicity one result 
of Corollary ll5.2f rom the results of [SZ] and [AG]. 
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16. Uniqueness of Fourier- Jacobi Models 

In this section, we continue with the assumption that k is non-archimedean and our 
goal is to estabhsh the analog of Theorem 115.11 in the symplectic and skew-hermit ian 
cases, which will imply that 

d{7r,^) < 1. 

Before coming to the analogous result, which is given in Theorem 116.11 we need to 
recall certain structural results about parabolic induction for the metaplectic groups. 

Recall that if is a symplectic space, then a parabolic subgroup P in Sp(Vr) is 
nothing but the inverse image of a parabolic P in Sp(W^). It is known that the meta- 
plectic covering splits (uniquely) over unipotent subgroups, so for a Levi decomposition 
P = M ■ N, it makes sense to speak of the corresponding Levi decomposition 

P = M-N in Sp{W). 

Furthermore, we note that for a maximal parabolic subgroup P{X) of Sp(iy) with 
Levi subgroup of the form M = GL(X) x Sp(11/o) in Sp(iy), 



M = (GL{X) X Sp{Wo)j /Afi2 

where GL(X) is a certain two-fold cover of GL(X) defined as follows. As a set, we 
write 

GL(X) = GL(X) X {±1}, 
and the multiplication is given by 

(5'i,ei) ■ {92,(^2) = {9192,(^162 ■ (det5(i,det5(2)), 
where (— , — ) denotes the Hilbert symbol on with values in {±1}. 

The two-fold cover GL(X) has a natural genuine 1-dimensional character 

: GL(X) Cx 

defined as follows. The determinant map gives rise to a natural group homomorphism 

det : GL(X) — > GL(A*"fX) = GL(1). 
On the other hand, one has a genuine character on GL(1) defined by 

(a,e) ^ e-7(a,?/;)~\ 

where 

7(a,^) = 7(^a)/7(^) 

and is an 8-th root of unity associated to ip by Weil. Composing this character 
with det gives the desired genuine character Xip on GL(X), which satisfies: 

xl{9,^) = (det(^),-l). 
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Thus, there is a bijection between the set of irreducible representations of GL(X) and 
the set of genuine representations of GL(X), given simply by 

Note that this bijection depends on the additive character ip of k. Now associated to 
a representation r of GL(X) and ttq of Sp(Wo); one has the representation 

K TTo of M. 

Then one can consider the (unnormalized) induced representation 

/^(r,7ro) = Indf(^)(f^K7ro). 

Here is the analog of Theorem 115.11 in the symplectic case. 

Theorem 16.1. ConsiderW = X^Wq^X"^ with X ^ and fix the additive character 
ip of the non-archimedean local field k. Let 

• T be a supercuspidal representation of GL{X); 

• ttq be a genuine representation o/Sp(Wo)/ 

• 71 be an irreducible representation ofSp{W), 

and consider the (unnormalized) induced representation /^(r, ttq) ofSp{W). Assume 
that TT^ does not belong to the Bernstein component associated to (GL(X) x Sp(iyo)5 tKI 
fi) for any representation /i ofSp{Wo). Then 



Proof. We shall compute 



Hom ~ (J^(r, TTo) ® uj^,^^, vr^). 



Let P{X) = M{X)-N{X) be the parabolic subgroup in Sp(Vr) stabilizing the subspace 
X, so that 

M(X) = (gL(X) X Sp{Wo)) /A/i2. 

The Weil representation uj^^^-;^ = uj'^^^ has a convenient description as a P(X)-module; 
this is the so-called mixed model of the Weil representation. This model of uj^r^^ is 
realized on the space 

of Schwartz-Bruhat functions on valued in cu^^^. In particular, evaluation at 
gives a P(X)-equivariant map 

' - |dety|i/2^ 
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where A^(^) acts trivially on the target space. In fact, this map is the projection of 
oj^^^^ onto its space of A'"(X)-coinvariants. 

On the other hand, to determine the kernel of the map ev, note that GL(X) acts tran- 
sitively on the nonzero elements of X'^ . Recall that we have fixed a basis {f i, ■ ■ ■ , Vn} 
of X in the definition of the data v^), with dual basis {v[, • • • , v'^ of X^. Let R 
be the stabilizer of v'^ in GL{X), so that R is the mirabohc subgroup of GL{X) and 
set 

Q = {Rx Sp(PFo)) • N{X) c P{X) 
so that its inverse image in P{X) is 

Q=({Rx s5(iyo))/A/i2) ■ N{X) c P(X). 
Then one deduces the following short exact sequence of P(X)-modules: 



> indJ^^^x^ldetxI^/^K^,^ > ul^^ x^\^^^x\^''' ^^l^,,^ > 0, 

where the compact induction functor ind is unnormalized and the action of Q on ^jS^^^^^ 
is via the Weil representation of Sp(Wo) • with respect to the character ■0. 

Tensoring the above short exact sequence by Kl ttq and then inducing to Sp(H^), 
one gets a short exact sequence of Sp(l^)-modules: 



i 

indg'^^Vetxr/' ■ tIk ® (tto ® u^^^^^ = A 
i 

i 

lnd%%\T ■ Idetxl^/^ ® (vro ® = C 

i 
0. 

By our assumption on tt, 

Homsp(w^)(C, tt"^) = and Homsp(iy)(-B, tt^) = Homsp(vF)(^, tt^). 
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Moreover, by a well-known result of Gelfand-Kazhdan, one has 

T\n = ind^X, 

where U is the unipotent radical of the Borel subgroup of GL(X) stabilizing the flag 

{vi) C t;2) C ■ ■ ■ C {vi, ■■■ ,Vn) = X 
and X is any generic character of U. Observing that 

H={UxSp{Wo))-N{X), 

we conclude that 

Therefore, the desired result follows by Frobenius reciprocity. □ 

Corollary 16.2. In the symplectic case over a non-archimedean local field, we have 

dime Hom//(7r ® zT^, C) < 1 
for any irreducible representation n of G = G{V) x G{W). 

One can prove an analog of Theorem 116.11 in the skew-hermitian case, including the 
case when k = ko x ko, and deduce the following corollary; we omit the details. 

Corollary 16.3. In the skew-hermitian case over a non-archimedean k, with W G V 
of even codimension, we have 

dime HomH(7r ® 17^, C) < 1 

for any irreducible representation tt = Try Kl t^w of G = G{V) x G{W) with iiv super- 
cuspidal. 



17. Local Conjectures 

In this section, we propose a conjecture for the restriction problem formulated in 
Section [TH Recall that we are considering the restriction of irreducible representations 
TT = TTv K VTVK of G = G{V) X G{W) to the subgroup H = N ■ G{W) C G. Recall also 
that, with auxiliary data if necessary, we have defined a unitary representation v oi H 
(or sometimes its double cover H), which has dimension 1 when W G V are orthogonal 
or hermitian, and has Gelfand-Kirillov dimensional 1/2 ■ dim{W/ko) when W G V are 
symplectic or skew-hermitian. Then we are interested in 

d^Tc) = dime Hom//(7r ® z7, C), 

which is known to be < 1 in almost all cases. In this section, we shall give precise 
criterion for this Hom space to be nonzero, in terms of the Langlands-Vogan param- 
eterization of irreducible representations of G. We first note the following conjecture, 
which has been called multiplicity one in L-packets. 
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Conjecture 17.1. There is a unique representation 7c of a relevant group G' = G{V') x 
G{W') in each generic Vogan L-packet 11^ of G which satisfies 

HomH(7r O z7,C) ^ 0. 

In two recent preprints [Wal] and [Wa2], Waldspurger has made substantial progress 
towards this conjecture in the orthogonal case. Namely, assuming certain natural and 
expected properties of the characters of representations in a Vogan L-packet, he has 
shown that the above conjecture holds for tempered packets in the orthogonal case. 
There is no doubt that his methods will give the same result in the hermitian case. 

We also note that when k = ko x k^, we have G = GL(Vo) x GL(M/o) so that the 
Vogan packets are all singletons. In this case, the above conjecture simply asserts that 
HomHin ^V, C) 7^ for any irreducible generic representation vr of G. In this case, we 
have: 



Theorem 17.2. (i) If k = k^ x ko, then Conjecture 17.1 holds when dimW-^ = or 
1. 



(a) If k = ko X ko is non-archimedean, then Conjecture 17.1 holds in general. 



Proof. When dimiy-*- = or 1, Conjecture 117.11 is an immediate consequence of the 
local Rankin-Selberg theory of Jacquet, Piatetski-Shapiro and Shalika ([JPSS] and 
[JS]). Indeed, the local Rankin-Selberg integral gives a nonzero element of IIomj:/(7r, u). 
When k is non-archimedean, the general case then follows from Theorems 115.11 and 
Theorem 116.11 □ 



In each of the remaining cases, we will make the above conjecture more precise 
by specifying a canonical character x of the component group A^. The character x 
depends on the choice of a generic character 6 of G (used to make the Langlands- 
Vogan parameterization canonical) and on the additional data needed to define the 
representation u when e = —1. We then conjecture that the representation tt in 
Conjecture 117.11 has parameter vr = n{{p,x) in the Vogan correspondence J{9). 

We treat the various cases separately. 

G = SOjV) X SOjW), dimW^ odd 

Here the character 6 is determined by the pair of orthogonal spaces W G V. In view 
of Proposition 112.11 specifying 6 amounts to giving a non-isotropic line L in the even 
orthogonal space (with L"*" split), and we simply take the line L to have discriminant 
equal to the discriminant of the odd space. The representation u is also canonical. 

The L-packet U^p is determined by a parameter 

if : WD — > Sp(M) X O(A^) 
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with dim N even. We define 

X = Xn xXm ■■ Am X A+ — > (±1), 
where the characters xn and xm were defined in ^ 

G = V{V) X V{W), dimW^ odd 

Here, in view of Proposition 112. 1^ we need to choose a nontrivial character 

up to the action of Nk^ in order to define a generic character 6*0 of the even unitary 
group. If 6 is the discriminant of the odd hermitian space, then we define 

e{x) = e{-2-6-x) 

and use 6 to fix the Vogan parametrization for the even unitary group. The represen- 
tation u is canonical. 

The L-packet is determined by a parameter 

ip : WD — > GL(M) X GL(A^) 

with M conjugate-symplectic of even dimension and N conjugate-orthogonal of odd 
dimension. We define: 

X = Xn y< Xm ■■ Am y< An — > (±1), 

using the character i/jq to calculate the local epsilon factors which intervene in the 
definition of x- 

G = §p{V) X SpjW) or SpjV) x SpjW), dimW^ even 

Here we need to choose a nontrivial additive character ip : k ^ to define a generic 
character 6 of the symplectic group, the notion of Vogan parameters for the metaplectic 
group and the representation z/^ of H. 

The L-packet is determined by a parameter 

if : WD — > Sp(M) X SO{N) 

with dimA^ odd. Let 

Ni = N®C 

be the corresponding orthogonal representation of even dimension and define 

X = XiVi X Xm ■■ Am x — > (±1). 

The group A^ is a subgroup of index 1 or 2 in Am x Aj^_^ and we take the restriction 
of X to this subgroup. 

G = U(y) X U(W^), W CV skew-hermitian and dimPF = dim\^ = 1 mod 2 
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Here there is a unique orbit of generic cliaracter 9. On the other hand, we need to 
choose 

V' : /co ^ 

up to N/c^ and 

^ : A;7NA;^ — ^ 
to define the representation of H. 

Let e be the discriminant of V and W which is a nonzero element of trace in k, 
well-defined up to Nk^ . Let 

which is a nontrivial character of k/ko, well-defined up to Nk^ . 

The L-packet has parameter 

ip : WD — > GL(M) x GL{N) 
with M and N conjugate-orthogonal representations of odd dimension. We define: 

X = Xiv X Xm(m-i) = Xiv(M-i) X Xm ■■ Am X An — > (±1), 
using ipQ to calculate the local epsilon actors which intervene in the definition of x- 

G = 1]{V) X U(I^), W gV skew-hermitian, dim = diml/ = mod 2 

In this case, we must choose t/j : ko ^ to define 9 for both groups, and // : 
kx/m"" to define u = i/y,,^. 

The parameter of an L-packet is 

if : WD — > GL(M) X GL(iV) 
with M and N conjugate- symplectic representations of even dimension. We define 

X = Xtv X Xm(m-i) = XNip-^) X xm ■■ Am X An — ^ (±1). 

Since the representations both have even dimension, the values of x independent 
of the choice of V'o used to define the epsilon factors. 

Conjecture 17.3. Having fixed the Langlands-Vogan parameterization for the group 
G and its pure inner forms in the various cases above, the unique representation tt in 
a generic Vogan packet which satisfies Homij(7r (8) I/, C) 7^ has parameters 

TT = 7r((/?,x) 

where x is as defined above. 

It seems likely that the approach used by Waldspurger in [Wal] and [Wa2] will lead 
to a proof of this precise local conjecture in the orthogonal and hermitian cases. 
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18. Compatibilities of local conjectures 
In this section, we verify that the precise conjecture 117.31 is independent of: 

(1) the bijection 

J{d) : ^ Hom(A^, ±1) 

given by the choice of a generic character 9 of G; 

(2) the scahng of the form (— , — ) on V and hence W ^ which does not change the 
groups G and H; 

(3) the data needed to define the representation u of H. 

This serves as a check on the internal consistency of the conjecture. Again, we consider 
the various cases separately. 

In the orthogonal case, the generic character 6 and the representation u of H are 
determined by the pair of spaces W G V and are unchanged if the bilinear form on V 
is scaled by . The character x = Xn x Xm depends only on the Langlands parameter 
ip : WD — y Sp(M) x O(A^). So our conjecture is internally consistent in this case, as 
there is nothing to check. 

In the hermitian case, both the generic character 6 and the character x = Xn x Xm 
depend on a choice of nontrivial i/jq : k/ko S^, up to multiplication by Nk^ , while 
the representation u is determined by the spaces W <Z V . On the other hand, if we 
scale the hermitian form on C by an element of fcg , the generic character 9, the 
representation v oi H and the character x of the component group are unchanged. 

To see the dependence of our conjecture on the choice of ipQ, suppose that t represents 
the nontrivial coset of ko/Nk^ and let 6'* be the generic character associated to ip(j{x) = 
ipoitx). For (a, 6) G Am x A^, we have 

X*(a, b) = e{M^ ® N, 4) ■ e(M ® N\ 4) 

= det M^it) ■ e(M" ® A^, ^o) ■ e(M ® N\ ^q) 

= via) ■ 

Here we have used the facts that M is conjugate-symplectic of even dimension and 
is conjugate-orthogonal of odd dimension. 

Now if the parameter of vr under J{6) is {ip,x), then its parameter under J{0^) 
is {f,x ■ v) = {f:X^)y according to the desiderata in ^ ITOl Hence our conjecture is 
independent of the choice of ipQ in the hermitian case. 
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In the symplectic case, we will discuss representations of G = Sp(H^) x Sp(V^); the 
case of representations of Sp(iy) x Sp(l^) is similar. In this case, we used the choice 
of an additive character ■?/' : — > up to multiplication by k^'^, to 

(i) define the notion of L-parameters M for representations of Sp(iy); 

(ii) define a generic character 6 for Sp(\^) and a generic character 6 for Sp(iy); 

(iii) define the representation u = for H. 

Note, however, that the character x of the component group Am is independent of the 
choice of ip. 

Suppose that under the ^/^-parameterization, the parameter (M, N, x) corresponds 
to the representation tt of G, so that our conjecture predicts that 

HomH(7r, z/^) ^ 0. 

Now replace the character ip by ipc for c G /k^^ and let n' be the representation of G 
corresponding to (M, A^, x) under the -i/'c-paranieterization. By our construction of the 
Vogan parameterization for metaplectic groups, it is easy to see that tt' is isomorphic 
to the conjugated representation tt'^. Thus, our conjecture for the character ipc predicts 
that 

HomniTi'^, z^^J 7^ and hence Homi^(7f, i/^^) 7^ 0. 
Since z/^ = z/^^, our conjecture is internally consistent with respect to changing ip. 

Note that the use of ip in (i) and (ii) above concerns the Vogan parameterization, 
whereas its use in (iii) concerns the restriction problem in representation theory. Hence 
there is no reason why one needs to use the same character ip for these two different 
purposes. 

Suppose that one continues to use ip for the Vogan parameterization in (i) and (ii), 
but uses the character ipdx) = ip{cx) to define the representation of H. Then for a 
given Vogan packet of G with ■^/'-parameter (p, one can ask which representation vr G IIi^ 
satisfies Hom//(7r, z/^J 7^ 0. This can be answered using Conjecture 117.31 together with 
Conjecture 111.31 from ^JTTJ We have: 

Proposition 18.1. Assume the conjectures \11.3\ and \17.3\ Let 

if : WD — > Sp(M) X SO(A^) 

be a generic Langlands parameter for Sp(W^) x Sp(V) relative to the nontrivial additive 
character ip of k. Let 

N, = N{c)®C forcek^'/k''^ 
Then the unique representation it in with B.omni'n', u^J 7^ corresponds under the 
bijection J [6 x 9) to the restriction of the character 

Xn, X xm ■■ Am X A+^ — > (±1) 
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to the subgroup = Am x A'^, multiplied by the character 

Vc{a) = detN\c) of A+. 

Proof. Let tt be the representation whose -j/^-parameter is (M, N, x), where x is as given 
in the proposition: 

X = Xn,xXm-Vc- Am x — > (±1). 

We want to show that 

HomH(vr, z/^J 7^ 0. 
By Conjecture 111.31 the -j/^c-parameters of n are {M{c), N,x') with 

x' = Xn, ■ v[c\ X xm ■ Vc- 

Hence, it suffices to show that x' is equal to the character predicted by Conjecture 117.31 
relative to ipc- More precisely, we need to show that 

X' = XNi X XAf(c)- 

We now calculate this character on an element 

(a', a) G Am x A+ = Am(c) x A+, 
using the fact that for a in ^Nc^ 

= N{c)\ 

Since this space has even dimension, 

detiV,'' = detiV^ = detiV^ 

Hence we have 

X'{a', a) = {xn, ■ r][c]){a') ■ XAiia) 

= e(M"' ® N^) ■ e(M"' ® (C © C(c))) • e(M ® A^,") ■ det(Ar^")(-l)5-'ii'"*^ 
= e(M"' ® {N{c) + C(c)) ■ e(M ® N^{c)) ■ det{N%c)){-l)r^''^^ 
= e{M{cY' iVi) ■ e(M(c) ® A^i") ■ det(iVf )(-l)5-'ii'"^ 
= (XjVi X XAf(c))(a',a). 

This proves the proposition. □ 

Finally, we consider the skew-hermitian case with C ^ of even codimension. We 
consider the two cases: 

(i) dim W = dim V ^ 1 mod 2; 
fii) dim W = dim V = mod 2 
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in turn. 

Assume first that dirnVT = dimV^ = 1 mod 2 and the discriminant of W and V 
is a trace zero element e & k. In this case, the Vogan parameterization is completely 
canonical, given the spaces W <Z V. However, the representation v oi H depends not 
only on the spaces W dV but also on the choice of an additive character ip : ko ^ 
and on the choice of a multiplicative character /j, : k^ ^ which is trivial on N(A;^) 
but nontrivial on /cq . Thus, to be completely precise, we denote the group H by Hwy 
and the representation u by vw,v,ii>,ti- Finally, the character x of the component group 
is defined using and the additive character 

i^^ix) = VClV(ex)) 

of k and depends on up to multiplication by Nfc^. 

Suppose without loss of generality that the representation tt with parameter (<^, %) is 
one for the group G{W) x GiV), so that our conjecture (for the character -0) predicts 
that 

B.ova.H^y{'K,i'w,v,ii>,ii) 7^ 0. 

If t represents the nontrivial coset of kg /Nk^ , let Xt be the character of defined 
using the character ipti^) — ip{tx). Then we have 

Xt{a, b) = e(M» ® iV(/x-i), ■ e(M ® A^(/.-l)^ 
= Via,,b) ■ x{a,b). 

Thus, the representation ttj indexed by the character Xt is one for the pure inner form 
G{W') X G{V'). Moreover, the spaces W C V are simply the spaces tW C tV obtained 
from W G V hy scaling the skew-hermitian forms by t. Thus, our conjecture (for the 
character ipf) predicts that 

RoinHt^ty(nt,utw,tv,iPt,u) 0. 

To see that this is equivalent to the prediction of our conjecture for the character ip, 
note that G{W') x G{V') is canonically identified with G{W) x G{V) as a subgroup 
of GL(l^) X GL{V) and under this identification, one has ttj = tt. Moreover, we also 
have Hw',v' — Hwy as subgroups of G{W) x G{V) and 

Hw,tv,tt,t,n = ^w,y,v,iu- 

This proves that our conjecture is internally consistent with changing ip. 

On the other hand, if we replace ^ by /^', then /i' — /i ■ /iq for some character 
Ho : k^/k^ -^C^. Moreover, we have [HKS] 
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Hence 

Romnin (g) z7^/,^, C) = Hom//((7r ■ /Xg ^) (g) 77^,^, C). 

Now our conjecture for /i' says that the left hand side of the above is nonzero if and 
only if Tc has Vogan parameter (M, A^, Xm,n,h') with 

= e(M'^ ® (iV ■ (/u-') , ^) ■ e(M ® (iV ■ fx^') (fi-'f, ^) 

On the other hand, our conjecture for /i says that the right hand side is nonzero if and 
only if 71 ■ /iQ^ has Vogan parameter {M, N{fiQ)~^,XM N{iig^) fJ- Thus, our conjecture 
for fi' is equivalent to that for /x. 

Finally, consider the case when dimly = diml^ = mod 2. In this case, we need 
the additive character ■?/' : fco — >■ to specify the Vogan parameterization, and both 
ip and /i to define the representation i'w,v,i^,ii- The character %, on the other hand, is 
independent of but depends on /i. 

Suppose that under the ^Z'- Vogan parameterization, the representation vr correspond- 
ing to the character x is one for the group GiV) x G(W), so that our conjecture for ip 
predicts that 

RomHy^^yiTc (g) Vwy,ip,fM, C) ^ 0. 

If we replace the additive character ip by ipt with t E but t ^ Nk^ , then under the ipt- 
Vogan parameterization, the character x corresponds to the conjugated representation 
TT* (using an element in the similitude group with similitude t). So our conjecture for 
ipt predicts that 

Homj^^y^(7r* (g Vw,v,,pt,i^, C) 0. 

But one may check that 

so that the two predictions (for ip and ipt) are consistent with each other. The consis- 
tency with changing /i is similar to the analogous situation treated above. 



19. Reduction to basic cases 
In this section, we shall show: 



Theorem 19.1. Assume that k is a non-archimedean local field. Then Conjectures 
17. 1\ and\l 7. 3\ follow from the basic cases where dimW^ = or 1. 



Proof. As we shall explain, this is a simple consequence of Theorems 115.11 and 116.11 
We treat the two cases separately. 
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We first consider the orthogonal and hermitian cases. Suppose that W <Z V with 

= X + + E 

where X = {vi, - ■ ■ , f„) is nonzero isotropic and ii^ is a non-isotropic hne. Let M and 
be L-parameters for GiV) and G(W) respectively. We would hke to verify Conjectures 
\T7A\ and [TTal for the associated Vogan packet Um x Un of G = G{V) x G{W). We 
shall exploit Theorem 115.11 for this purpose. 

Recall the setting of Theorem 115.11 where we have set 

W' = V® i-E) = V®k-f 

and 

Y = {Vi, ■ ■ ■ ,Vn,Vn+l) 

with Vn+i = e + /. Then we have 

W' = Y + + W. 

Let r be an irreducible supercuspidal representation of GL(y) with L-parameter A^^-. 
We may assume that for any eUn, the induced representation 

/(r, 7iw) = IndpJJT) V ^ TTvy) 

is irreducible. Then the set 

{I{T,nw) : TTw e Hiv} 
is simply the Vogan packet associated to the parameter 

N' = Nr + N + ^N^. 
Moreover, there is a canonical isomorphism 

An = An' 

and the representations hw and J(r, ttvk) are indexed by the same character of A'^ = 

We may further assume that r is chosen so that the conditions of Theorem 115.11 are 
met. Then by Theorem 115. H we see that for any Try G Um, 

HomG(y)(/(T, TTw) ® VTy, C) = Homj^(7ry TTiv, C). 

Thus, Conjecture 117.11 holds for Ha/ x Htv if it holds for U^i x Um- To see that the 
same implication holds for Conjecture 117.31 it suffices to check that the character 

Xn X Xm of X 

agrees with the character 

Xn' X Xm of Alj X v4+,. 
For a G A'lj, we see from definition that 

XN'{a) = Xiv(a) ■ X7v.+-7vv(a), 
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and it follows by Proposition 15.11 

Xiv.+-JV,^ («) = 1 for any a G . 
This establishes Theorem 119.11 in the orthogonal and hermitian cases. 

The symplectic and skew-hermitian cases are handled in a similar way, using Theo- 
rem [T6]T| we omit the details. □ 

20. Variant of the local conjecture 

In this section, we give a variant of the local conjecture I17.3[ This variant does 
not require the precise parameterization of the members of a Vogan L-packet by the 
characters of the component group, which can be a very delicate issue. This conjecture 
is typically what is checked in practice. 

Suppose that W <Z V and we are given an L-parameter M of GiV), so that M is 
a self dual or conjugate-dual representation of the Weil-Deligne group WD of k with 
a given sign. As described in §11 the component group Am is an elementary abelian 
2-group with a canonical basis {oj}, indexed by the distinct isomorphism classes of 
irreducible summands Mj of M which are of the same type as M. Hence, we have a 
canonical isomorphism 

Am = Z/2Z • ai X ■ ■ ■ X Z/2Z ■ a^. 
Here, the elements are such that 

M"' = Mi. 

Now consider a representation n of G{V) in the Vogan packet H^- Let Cw{t!') denote 
the set of generic L-parameters for G{W) such that 

ci(7r,A^):= dimHomiy(7rK7r',z/) ^ 0. 

According to our Conjecture 117. H one has a partition 

{generic L-parameters of G{W)} = Cw{t^)- 

In this context, we have the following variant of Conjecture 117.31 

Conjecture 20.1. (1) Fix tt G Hm- For any two L-parameters N and N' in Cw{'^), 
we have: 

(i) in the orthogonal case, 

e{Mi ®N,ij) = e{Mi ® N' , ^j) G {±1} for any i, 

where ip is any nontrivial additive character of k; 
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(ii) in the unitary case, 

e{Mi <S)N,iIj) = e{Mi ® N' , ip) e {±1} for any i, 
for any nontrivial additive character ofk/ko. 
(Hi) in the symplectic case, with v = v^, 

e{Mi (S)N,tp) = e{Mi <S) N' , ip) e {±1} for any i. 

(iv) in the skew-hermitian case, with v = v-^^^, 

e(M, ® N{iJ-^),^) = e{Mi ® N'{i2'^),^) G {±1} for any i, 
where ip is any nontrivial additive character of k/k^. 

In particular, vr determines a character x-k on Am, defined by 

for any N G £14/ (vr) and a fixed ip appropriate for each of the cases above. 

(2) The map it Xtt gives a bisection (depending on the choice of a character ip) 

< > Irr{AM). 

(3) One has the analogs of (1) and (2) above with the roles ofV and W exchanged. 

The above conjecture says effectively tliat one can exploit the restriction problem for 
W G V and use the collection of epsilon factors described above to serve as parameters 
for elements of Hm- In the hermitian and skew-hermitian cases, the character Xtt 
associated to a given vr G IIm is equal to the character xn of Am defined in ^ for 
any G Cwi'^), provided the additive character ip is appropriately chosen. In the 
orthogonal and symplectic cases, these two characters may differ. 

21. UNRAMIFIED PARAMETERS 

In this section, we assume that /c is a non-archimedean local field with ring of integers 
A, uniformizing element w and finite residue filed A/wA. We will also assume that 
A/wA has characteristic p > 2, so that the group A^ /A^"^ has order 2. 

In the case when k has a nontrivial involution a, we will assume that the action of cr 
on y4/ wA is also nontrivial. Then k is unramified over ko and every unit in the subring 
Aq of A fixed by a is the norm of a unit of A. 

In addition, we will only consider additive characters ip of k which are trivial on A 
but not on w~^A. Then ip is determined up to translation by a unit in A. If we insist 
that ip'^ = ip^^, then ip is determined up to translation by a unit in Aq. We call such 
additive characters of k unramified. 
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Let WD = W{k) X SL2(C) be the Weil-Deligne group of k. A representation 

if : WD — > GL(M) 

is unramified if (/? is trivial on SL2 and on the inertia subgroup / of W{k). An unramified 
representation is determined by the semisimple conjugacy class ^p{F) in GL(M). Let 
C(s) denote the one dimensional unramified representation with (p{F) = s G C^. Then 
any unramified representation M is isomorphic to a direct sum of the form 



M = C(si ) , with n = dim M. 



i=l 



We now determine which unramified representations of WD are selfdual or conjugate- 
dual (with respect to the unramified involution cr of A;) . 

Proposition 21.1. Assvme that M is an unramified representation of WD and is 
either selfdual or conjugate-dual. Then M is isomorphic to a direct sum of the form: 

M ^ ®i{C{si) + C{s-^)) e m ■ C(-l) e n ■ C(l), 

with Si 7^ in and m,n> inZ. 
If M has this form, then we have: 

(i) M is orthogonal and its centralizer in SO(M) has component group 



_\ ^/2Z, if both m,n>Q, 
^ 1, otherwise. 



(a) M is symplectic if and only ifm = n = mod 2, in which case its centralizer in 
Sp(M) has component group 

Am = 1. 

(Hi) M is conjugate-orthogonal if and only ifm = mod 2, in which case its central- 
izer in Aut(M, B) has component group 



Z/2Z, zfn>0, 
1, otherwise. 



(iv) M is conjugate-symplectic if and only ifn = mod 2, in which case its central- 
izer in Aut(M, B) has component group 



Z/2Z, ifm>0, 
1, otherwise. 
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Proof. Since C(s)^ = C(s~^) and C(s)'^ = 'C(s), the one dimensional representation 
C(s) is selfdual or conjugate-dual if and only if = 1. In the selfdual case, both C(— 1) 
and C(l) are orthogonal. In the conjugate-dual case, C(l) is conjugate-orthogonal and 
C(— 1) is conjugate-symplectic. Indeed, the character 

H : k^'/Nk'' — > (±1) 

defined by 

is nontrivial on /cq . The proposition follows easily. □ 



Proposition 21.2. (i) If M and N are two selfdual unramified representations of WD 
of even dimension, with signs cm and respectively, then the character 

XN-.Al,^ (±1) 

defined by 

XN{a) =e(M"® AT,^) .detM"(-l)5<ii'-^.detA^(-l)5'^^'"^" 

is trivial. 

(a) If M and N are two conjugate- dual unramified representations with signs cm and 
cjv respectively and ip'^ = then the character 

Xiv : ^ (±1) 

defined by 

XN{a) = e{M''®N,ilj) 

is trivial. 



Proof. If M is any unramified representation of WD and ^jJ is an unramified additive 
character, then we have the formulae: 

e(M, -0) = 1 and det M(-l) = 1. 

The proposition follows easily from these facts. □ 



We now turn to the restriction conjectures for unramified generic parameters (/?. 
Since xn x Xm is the trivial character of A^. the unique representation in the associated 
Vogan packet which supports a nonzero Hom space should be the one indexed by the 
trivial character. In that case, for the purpose of global applications, we can make our 
conjectures more refined. 

Recall that W (ZV is a. pair of nondegenerate spaces for the sesquilinear form (—,—). 
and that W-^ is split. We say that an ^-lattice L cV is nondegenerate if 

(1) (-,-) :LxL^A; 
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(2) the map L Hom(L, A) defined by mapping w to = (w, w) is an isomorphism 

of 74o-modules. 

We assume henceforth that there is a nondegenerate A-lattice L C Vwith the ad- 
ditional property that L^r — L fl 1^ is a nondegenerate ^-lattice in W. Then the 
orthogonal complement of Lw in L is a nondegenerate lattice in W-^, so that 
has the form 

Y + or Y + Y"^ + Ae 

with Y isotropic and = Hom(y, A). Moreover, L = Lw + L^. 

Under this assumption, the group G = G{V) x G{W) is quasi-split and split by 
an unramified extension of ko. Indeed, the subgroup J = Aut(L) x Aut{Lw) is a 
hyperspecial maximal compact subgroup of G. We now construct the subgroup H of 
G and the unitary representation u oi H using this unramified data. 

Write L — Lw + Ly^, and define the parabolic subgroup Pa and its unipotent radical 
Na using a complete 74-flag in the isotropic subspace Y C L^. Then 

Ha^Na- kut{Lw) 

gives a model of H over Aq and 

Ha = JnHA{ko) ^JnH. 

In the orthogonal and hermitian cases, the one dimensional representation u oi H 
associated to the decomposition 

L^ = Y + Y^ + Ae 

and a suitable unramified additive character ip has trivial restriction to the subgroup 
J n H. In the metaplectic case, we can define u = using an unramified additive 
character t/j (there are two choices, up to translation hy A^'^). In the skew- hermitian 
case, we define u — u^^^ using an unramified character with ip'^ — (which is unique 
up to translation by NA^) and the unramified symplectic character associated to the 
representation C(— 1). Then in all cases, the representation z/ of is J Pi iif-spherical; 
it has a unique line fixed by the compact open subgroup J (1 H. 

Since the group G is quasi-split over fco, we can also define unramified generic char- 
acters 9 of the unipotent radical t/ of a Borel subgroup, using the pair L^y C L of 
nondegenerate lattices and a suitable unramified additive character ■0. Again, the T- 
orbit of 9 is unique except in the metaplectic case when there are two unramified orbits. 
In all cases, the restriction of 9 to the compact open subgroup J (lU is trivial. 

To summarize, if we use unramified data to define the representations 9 oi U and u 
of H, then the complex vector spaces 



Homjn[7(C, 9) and Homjnif(C, u) 



82 WEE TECK GAN, BENEDICT H. GROSS AND DIPENDRA PRASAD 

both have dimension equal to 1. 

Now let ip be an unramified generic parameter and let vr be the unique 6'-generic 
element in the Vogan packet tt^. Then the formula of Casselman and Shalika [CS] 
shows that 

(i) Homj(C,7r) has dimension 1; 

(ii) the pairing of one-dimensional complex vector spaces 

Homj(C, tt) ® Homc;(7r, 9) — > Homjnc/(C, 9) = C 
is nondegenerate. 
We conjecture that the same is true for the representation v of H . 

Conjecture 21.3. Let tt be the unique J -spherical representation in the Vogan packet 
n<^. Then 

(i) Homj:/(7r, z/) has dimension 1; 

(ii) the pairing of one- dimensional complex vector spaces 

Homj(C, tt) ® Hom//(7r, u) — > Homjn_f/(C, u) 
is nondegenerate. 

Besides the cases treated by Casselman-Shahka [CS], this conjecture has been verified 
in a large number of cases, which we summarize below. 

Theorem 21.4. Conjecture \21.3\ is known in the following cases: 

(i) the special orthogonal and hermitian cases; 

(ii) the general linear case, with dimW-^ = 1; 
(Hi) the symplectic case, with dimly-*- = 2; 

Proof. The orthogonal case is due to Kato-Murase-Sugano [KMS]. Their proof is ex- 
tended to the unitary case by Khouri in his Ohio-State PhD thesis [Kh]. Parts (ii) and 
(iii) are both due to Murase-Sugano [MSI, MS2]. □ 

22. AUTOMORPHIC FORMS AND L-FUNCTIONS 

The remainder of this paper is devoted to formulating global analogs of our local 
conjectures. 

Let F be a global field with ring of adeles A and let G be a reductive algebraic group 
over F. Then G{F) is a discrete subgroup of the locally compact group G{K). For 
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simplicity, we shall further assume that the identity component of the center of G is 
anisotropic, so that the quotient space G{F)\G{A) has finite measure. 

We shall consider the space A{G) of automorphic forms on G, which consists of 
smooth functions 

/ : G{F)\G{A) C 

satisfying the usual finiteness conditions, except that we do not impose the condition 

of Xoo-finitcness at the archimedean places. For each open compact Kf C G{Af), the 
space A{G)^f has a natural topology, giving it the structure of an LF-space(see [W2]) 
with respect to which the action of G{F ^ M) is smooth. 

Let Ao{G) C A{G) denote the subspace of cusp forms. An irreducible admissible 
representation tt = tToo <8) tt/ of G{A) is cuspidal if it admits a continuous embedding 

n-^Ao{G). 

The multiplicity of vr in Aq{G) is the dimension of the space Homc!(A)(7r, Aq{G)), which 
is necessarily finite. 

Suppose now that G is quasi-split, with a Borel subgroup B — T -U defined over F. 
A homomorphism A : U — > Ga is generic if its centralizer in T is equal to the center of 
G. Composing Aa with a nontrivial additive character ip of A/F gives an automorphic 
generic character 9 — ip o X. Now one may consider the map 

F{9) : AiG) C{9) 

defined by 

/ fiu)-9{u)du. 

JuiF)\UiA) 

The map F{9) is a nonzero continuous homomorphism of [/(A)-modules, which is 
known as the 9-Fourier coefficient. If F{9) is nonzero when restricted to tt C A{G), 
we say that tt is globally generic with respect to 9. 

The notion of automorphic forms can also be defined for nonlinear finite covers G{A) 
of G(A), which are split over the discrete subgroup G{F); see [MW]. For the purpose 
of this paper, we only need to consider this in the context of the metaplectic double 
cover of Sp(M^)(A) and so we give a brief description in this case. 

Assume that the characteristic of F is not two. For each place v of F, we have a 
unique nonlinear double cover Sp(W){F^) of Sp{W){F^). If the residual characteristic 
of Fy is odd, then this cover splits uniquely over a hyperspecial maximal compact 
subgroup Fy of Sp{W){Fy). Hence, one may form the restricted direct product 

llSp{W){Fy), 
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which contains a central subgroup Z = (BvlJ'2,v If Z'^ denotes the index two subgroup 
of Z consisting of elements with an even number of components equal to —1, then the 
group 

Sp(l^)(A) := ||j]Sp(iy)(F,)j /Z+ 

is a nonlinear double cover of Sp(Vr)(A). It is a result of Weil that this double cover 
splits uniquely over the subgroup Sp(VF)(F), so that we may speak of automorphic 
forms on Sp(l^)(A). An automorphic form / on Sp(l^)(A) is said to be genuine if it 
satisfies 

/(e • fl') = e • fig) for e e ^2- 
We denote the space of genuine automorphic forms on Sp(l^)(A) by ^(Sp(l^)). 

If = T ■ ?7 is a Borel subgroup of Sp(iy), then the double covering splits uniquely 
over U{Fy) for each v. Hence, in the adelic setting, there is a unique splitting of the 
double cover over U{A), and more generally over the adelic group of the unipotent 
radical of any parabolic subgroup of Sp(M^). As a result, one can define the notion 
of cusp forms as in the linear case, and we denote the space of such cusp forms by 
^o(Sp(H^)). Moreover, if 6* is a generic automorphic character of U, then one can 
define the ^-Fourier coefficient of / in the same way as before. 

For the global analog of our restriction problems, we also need to discuss the notion 
of automorphic forms on the non-reductive group 

Jw = Sp(VF) K H{W) 

where H{W) is the Heisenberg group associated to W. The group Jw is called 
the Jacobi group associated to W and we shall consider its double cover Jw{A) = 
Sp(W^)(A) ■ H{W){A). The space of automorphic forms A^{Jw) on Jw{A) is called 
the space of Jacobi forms. It consists of certain smooth functions on Jw{F)\Jw{A) 
with central character ip. 

For our applications, we are interested in a particular automorphic representation of 
Jw{A), namely the automorphic realization of the global Weil representation associated 
to -0 = riijV'i;- Recall that for each place v, the group 

Jw{F,) = MW){F,) ■ H{W){F,) 

has a local Weil representation cu^^ whose restriction to H{W){Fy) is the unique irre- 
ducible representation with central character ipy. The restricted tensor product 
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is the global Weil representation associated to ip. One of the main results of Weil [We] 
is that there is a unique continuous embedding 

Composing 6^ with the restriction of functions from Jvk(A) to Sp(H^)(A) gives a 
Sp(PF)(A)-equivariant (but not injective) map 

We now come to the global L-functions and epsilon factors associated to a cuspidal 
representation tt, following Langlands. To define an L-function or epsilon factor, one 
needs the extra data of a finite dimensional representation R of the L-group ^G. If 
TT = <S>v'^v is an automorphic representation and we assume the local Langlands- Vogan 
correspondence for G{Fv), then each tt^ determines a local L-parameter 

0, : WD{F,) 

Hence, one has the local L-factors L{R o cf)^^ s) and one defines the global L-function 

L(7r, i?, s) = JJ^ L{R o 0„, s), 

V 

which converges when Re{s) is sufficiently large. One expects that this L-function 
has meromorphic continuation to the whole complex plane and satisfies a functional 
equation of a standard type. Similarly, one has the local epsilon factors 

e^(7r, R, ip, s) = e{R o 0^, ip^, s), 

and one defines the global epsilon factor by 

e(7r, i?, s) = JJ^ e^(7r, R, ip, s). 

V 

It is a finite product independent of the additive character tp of A/F. 

The following table gives some examples of R and their associated L-functions which 
appear in this paper. When the cuspidal representation tt is globally generic, the 
meromorphic continuation of these L-functions are known. 
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G 




R 


GL{V) 


GL(M) 


Sym^M 


GL{V) 


GL(M) 


A^M 


GL{V/E), E/F quadratic 


(GL(M) X GL(M)) ■ Gal(E/F) 


As^(M) 


GL{V) X GL{W) 


GL(M) X GL(iV) 


M(g)N 


SO{W) X SO{V), dimW^ odd 


0(M) X Sp(A^), dimM even 


M ®N 


Sp{W) X §p{V) 


SO(M) X Sp(iV), dimM odd 


M ®N 


V{W) X V{V) 


(GL(M) X GL(iV)) ■ Gal{E/F) 


Indg^(M ® N) 



23. Global Restriction Problems 

We are now ready to formulate the global restriction problems. We shall change 
notations slightly from the earlier part of the paper, by replacing the pair of fields 
ko <Z k in the local setting by F C -E in the global setting. Hence a is an involution 
(possibly trivial) on E with E^ = F, and is a vector space over E equipped with a 
sesquilinear form (— , — ) of the relevant type. The group G = G{V) is then an algebraic 
group over F. Also, we shall include the case E = F x F in our discussion. 

Suppose that we have a pair of vector spaces W C V over E equipped with a 
sesquilinear form of sign e, such that W~'~ is split and e ■ (_i)dimw _ Then we 
have the groups 

G = G{V) X G{W)] 
H = N ■G{W) 

over F, as defined in ^ 

The groups of F-points G{F) and H{F) are discrete subgroups of the locally compact 
adelic groups G(A) and if (A) respectively. In the orthogonal case, we assume that if V 
or W has dimension 2, then it is not split. Then the quotient spaces G{F)\G{A) and 
H{F)\H{A) both have finite measure. We may then consider the space of automorphic 
forms and cusp forms for these groups, as in §22l 
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In this section, we will consider irreducible tempered representations vr of G{A) which 
occur in the space of cusp forms Ao{G) on G{F)\G{A) and study their restriction 
to H{A). As in the local setting, when G is quasi-split, we need to introduce an 
automorphic generic character 

e : U{F)\U{A) — > §^ 

for the group G; this serves to fix the local Langlands-Vogan parameterization at all 
places V of F. In addition, we need to construct an automorphic representation u on 
H{F)\H{A) for the restriction problem. 

Assume that G = G(y) x G(W) is quasi-split. In the orthogonal or symplectic case, 
we use the spaces W G V to naturally define a generic F-homomorphism 

X:U — >Ga 

as in ^ |T2l Composing Aa with a nontrivial additive character 

: A/F — > §^ 
gives an automorphic generic character 

e = iijox. 

In the hermitian or skew-hermitian case, we use the spaces C ^ to construct a 
generic homomorphism 

A : U — > ResE/piGa) 

with image in IiesE/F{GaY^~'^ ■ Then, in the hermitian case, we compose Aa with a 
fixed nontrivial additive character 

^0 : Ae/{E + A) ^ §^ 

to obtain an automorphic generic character = V^o ° -^a- We then translate Oq by —2 
times the discriminant of the odd hermitian space to obtain an automorphic generic 
character 6 of the even unitary group. In the skew-hermitian case, we compose Aa with 
a nontrivial additive character 

^ : A/F — > §^ 

to obtain 6 = ip o Aa- 

Next, we need to define an automorphic version of the representation u of H{A) = 
N{A) ■ G{W){A). In the orthogonal and hermitian cases, we define u by composing 
the generic G'(l^)-invariant map 

l:N^ ResE/F{Ga), 

constructed in ^ IT2] using the spaces W C V, with a nontrivial additive character 
ip : Ae/E — s> S"*^ and then extending this trivially on G{W){A); 
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As in the local case, the choice of ip is unimportant. Then we define: 

F{u) : A(G) C(z/) 

by 



/^/ f{h)-u{h)-dh. 

J H{F)\H(k) 

The map F{v) is called a Bessel coefficient. 

In the symplectic and skew-hermitian cases, the representation v is infinite-dimensional; 
so the situation is slightly more involved. Recall from ^ IT2] that, using the spaces 
C V", we have defined a G(Vr)-invariant generic linear form 

Composing this with a nontrivial additive character ip : K/F and extending 

trivially to G{W){K), we obtain an automorphic character 

A = ^ o /a 

of H{A). On the other hand, we have also defined a homomorphism 

N — > H{W) 

where 

H{W) =F® ResE/pW 
is the Heisenberg group associated to ResE/F{W). Thus, we have a homomorphism 
H = G{W) -N — > Jw-= Sp{ResE/F{W)) ■ H{W). 

As discussed in p2| the group Jvy(A) has a global Weil representation with central 
character ip, and one has a canonical automorphic realization 

9^ : ^ A{Jw)- 

It will now be convenient to consider the symplectic and skew-hermitian cases sepa- 
rately. 

In the symplectic case, the map H — > Jw defined above gives rise to a map 

^(A) — > Jw{A). 

By pulling back, one can thus regard uj^ as a representation of J(A). Moreover, the 
above map gives rise to a natural inclusion 

A{Jw) ^ A{H). 

Composing the automorphic realization 6^ with this inclusion realizes a;^ as a sub- 
module in A{H). Multiplying by the automorphic character A of H, one obtains an 
automorphic realization 

9^ : = LU^ (g) X ^ A{H). 
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Now we can define the map 

by 

f®(t>^ I f{h)-'ej^dh. 

Jh{f)\h{a) 

The map F{u^) is called a Fourier- Jacobi coefficient. 

In the skew-hermitian case, we choose an automorphic character 

satisfying 

Then one obtains a splitting homomorphism 

s^,^ : H{A) Jw{A). 

Using s^^^, one may pull back the global Weil representation cu^ to obtain a represen- 
tation cu^^fj, of if (A). As above, one also obtains an automorphic realization 

0ip,n '■ ^i:,ix — ^i),tx ® ^ — ^ A{H). 
Thus, we can define the map 

by 



f®(P^ f{h)-e^,^{<t>)dh. 

J H{F)\H{k) 

The map F{u^^ij) is called a Fourier- Jacobi coefficient in the context of unitary groups. 

Now the global restriction problem is: 

Determine whether the map F{v) defined in the various cases above is nonzero when 
restricted to a tempered cuspidal representation tt of G{A) . 

24. Global conjectures: central values of L-functions 

To formulate our global conjectures to the restriction problem of the previous section, 
we need to introduce a distinguished symplectic representation R of the L-group 
over F. We set 

M ® N in the orthogonal and symplectic cases; 
Indg*^(M ® N), in the hermitian case; 
Indg^(M (g) N(ijl'^)), in the skew-hermitian case. 



R^ < 
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This representation R was already introduced in the table at the end of ^22\ except 
that in the skew-hermitian case, we incorporate the character /i used in the definition of 
u. It is this twist by /i that makes R a symplectic representation in the skew-hermitian 
case (by Lemmas 13 .41 and 1 3.51) . As explained in ^22\ we can then speak of the L-function 
L(7r, R, s) and the global epsilon factor e{n, R, s) for any automorphic representation 
TT of G. 

The first form of our global conjecture is: 

Conjecture 24.1. Let tt be an irreducible tempered representation of G{A) which oc- 
curs with multiplicity one in the space Ao{G) of cusp forms on G{F)\G{A) . Then the 
following are equivalent: 

(i) the restriction of the linear form F{v) to tt is nonzero; 

(a) the complex vector space Homj|/(A)(7r, z/) is nonzero and the L-function L{7r,R,s) 
does not vanish at s = 1/2, which is the center of the critical strip; 

(Hi) the complex vector spaces HomH{Fv){TTv,^v) are nonzero for all v and L^tc, R, 1/2) ^ 
0. 

Let us make some remarks about this conjecture. 

When E = F F, with G = GL{Vo) x GL{Wo), then the L-function L{7t,R,s) is 
the product 

L(7r, R, s) = L{tiy tcw, s) ■ L{TCy x vr^, s) 

of two Rankin-Selberg L-functions, so that 

L{7i,R,l/2) = \L{n, X nw,l/2)\^. 

In this case, the conjecture is known when diml^-*- = 1. Indeed, this is an immediate 
consequence of the integral representation of the global Rankin-Selberg L-function 
L(7ry X Tiw, 1/2) [JPSS]. The general case seems to be open. 

More generally, under the assumption that vr is globally generic, the implication (i) 
=^ (ii) has been shown by Ginzburg-Jiang-Rallis in a series of papers for the various 
cases [GJR1,2,3]. Moreover, in the hermitian case with dimly-*- = 1, an approach to 
this conjecture via the relative trace formula has been developed by Jacquet and Rallis 
[JR]. 

Further, one expects a refinement of Conjecture 124.11 in the form of an exact formula 
relating |F(z/)p with the central value L{n, R, 1/2). Such a refinement has been formu- 
lated by Ichino-Ikeda [II] in the orthogonal case, with dimly-*- = 1. In the analogous 
setting for the hermitian case, the formulation of this refined conjecture is the ongoing 
thesis work of N. Harris at UCSD. 
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As formulated, the global conjecture 124.11 is essentially independent of the local 
conjectures 117.11 and I17.3[ Rather, they complement each other, since the local non- 
vanishing in Conjecture 124.11 is governed by our local conjectures. From this point of 
view, the appearance of the particular central L- value L{7t, i?, 1/2) may not seem very 
well-motivated. However, as we shall explain in the next two sections, if we examine 
the implications of our local conjectures in the framework of the Langlands-Arthur 
conjecture on the automorphic discrete spectrum, the appearance of L{n, R,l/2) is 
very natural. 

For example, observe that the global conjecture 124.11 in the symplectic/metaplectic 
case involves the central L-value of the symplectic representation R = M ® N with 
M symplectic and N odd orthogonal, whereas in the local conjecture I17.3[ it is the 
epsilon factor associated to M ® (A^ © C) which appears. So in some sense, the global 
conjecture is less subtle than the local one. The explanation of this can be found in 
§261 as a consequence of the Langlands-Arthur conjecture (or rather its extension to 
the metaplectic case). 

Finally, we highlight a particular case of the conjecture. As we explained in ^ IT2| 
special cases of the data (if, v) are automorphic generic characters u = 6 on H = U. 
These cases are highlighted in the following table, and arise when the smaller space W 
is either or 1-dimensional. 



G{V) 


dim 


G{W) 


N 


odd orthogonal 





SO(0) 





even orthogonal 


1 


Sp(0) 





symplectic 





Sp(0) 





metaplectic 





S0(1) 


c 


odd hermitian 





GL(0) 





even skew hermitian 





GL(0) 






As one sees from the table, in all except the metaplectic case, = so that R = 
and L{7c,R,s) is identically 1. In the metaplectic case, A^ = C so that R = M and 
L{tt, R, s) is the standard L-function L{7r, s). Hence Conjecture 124. II specializes to the 
following conjecture in these degenerate cases. 
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Conjecture 24.2. Let tt be an irreducible tempered representation of G{A) which oc- 
curs with multiplicity one in the space Ao{G) of cusp forms on G{F)\G{A) and let 9 
be an automorphic generic character for G . Then, when G is linear, the following are 
equivalent: 

(i) the restriction of the map F{6) to tt is nonzero; 
(a) the complex vector space B.omu(^^) {it, 6) is nonzero. 

(Hi) the complex vector spaces }^om^(^p^^{7Ty, 9^) are nonzero for all places v of F. 

When G = Sp{V){A) is metaplectic, we fix an additive character ip of A/F which 
determines an automorphic generic character 6 and also gives the notion of Langlands- 
Vogan parameters. For any element c E F^ / F^'^ , let let Xc be the associated quadratic 
character of A^/F^ and let O^. denote the translate of 6 by c. Then the following are 
equivalent: 

(a) the restriction of the map F{6c) to tt is nonzero; 

(b) the complex vector space Hom[7(A)(7r, 6^) is nonzero and L{tt Xc, 1/2) 7^ 0; 

(c) the complex vector spaces Hom^(^^)(7r^,, ^c,i>) (ii"^ nonzero for all places v of F and 
L{tt0XcA/2)^O. 

If the above conditions hold, the space Hom;7(A)(7r, 0) has dimension 1 and F{6) is a 
basis. Moreover, the adjoint L-function L{tt, Ad, s) o/vr is regular and nonzero at s = 1 
(which is the edge of the critical strip). 

In the metaplectic case, with dim V = 2, the above conjecture is known by the work 
of Waldspurger [Wal]. 

25. Global L-parameters and Multiplicity Formula 

In this section, we review the notion of global L-parameters in the context of a 
fundamental conjecture of Langlands and Arthur [Al, A2], concerning multiplicities 
of representations in the automorphic discrete spectrum. We will only present this 
conjecture for tempered representations, and will also discuss its simplification for the 
classical groups considered in this paper. In the next section, we shall re-examine 
the global conjecture 124.11 in the framework of the Langlands- Arthur conjecture. We 
assume that E is a field henceforth. 

Let G be a connected reductive group over the global field F, and assume that 
the quotient space G{F)\G{A) has finite volume. The Langlands- Arthur conjecture 
gives a description of the decomposition of the discrete spectrum L^jg^(G(F)\G(A)) 
or equivalently the space A^{G) of square-integrable automorphic forms. We shall 
only describe this conjecture for the tempered part of the discrete spectrum, which we 
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denote by -Z^disc,temp(^)- Note that -Z^disc,tcmp(^) necessarily contained in the cuspidal 
spectrum by a result of Wallach [W3] . 

Suppose that Gq is the quasi-split inner form of G over F, with a Borel-subgroup 
B = T ■ U . Fix an automorphic generic character 9 = ®y9y of U as in the previous 
section. We fix an integral structure on G, which determines a hyperspecial maximal 
compact subgroup C GQ^Fy) for almost all finite places f , as in If G = GiV) 
is a classical group, such an integral structure is given by fixing a lattice L dV . 

The Langlands- Arthur Conjecture 

(1) For any pure inner form G = G{V) of Gq, there is a decomposition 

-^disc,temp(^) = ^^^-^|(^)' 

where (p runs over the discrete global L-parameters and each is a G(A)-submodule. 
The precise definitions of these objects are given as follows. 

By definition, a discrete global L-parameter is a homomorphism 

(p-.Lp — >^G = ^Go = GyiWF 

such that its centralizer in the dual group G is finite. These parameters are taken up 
to conjugacy by the dual group G. Moreover, Lp is the hypothetical Langlands group 
of F - the global analog of the Weil-Deligne group WD{Fy) - whose existence is only 
conjectural at this point. One postulates however that there is a natural surjective 
map 

Lp — > Wp (the Weil group of F), 

and the projection of (j) to the second factor Wp in ^G is required to be this natural 
surjection. Moreover, one postulates that for each place v of F, there is a natural 
conjugacy class of embedding 

WD{Fy) — > Lp. 

Assuming the above, one may attach the following data to a given discrete global 
L-parameter 0: 

(i) a global component group 

= %(Im((/))), 

which is finite by assumption. 

(ii) for each place v of F, a local L-parameter 

(j), : WD{F,) > Lp ^Go 



WEE TECK GAN, BENEDICT H. GROSS AND DIPENDRA PRASAD 



for the local group Go,i;, such that for almost all v, (j)y is unramified. This gives 
rise to a natural map of component groups: 

One thus has a diagonal map 

A:A^^l[A^^. 

V 

for each place v, the local Vogan packet 11^^ of irreducible representations of 
the pure inner forms G{Fy), together with a bijection 

J{e,) : ^ Irr(A^J 

specified by the local component 6^ of the automorphic generic character 6. For 
an irreducible character rjy of , we denote the corresponding representation 
in by tt^^. In particular, the representation corresponding to the trivial 
character of A^^ is a representation of Gq{F^,) and for almost all v, it is spherical 
with respect to the hyperspecial maximal compact subgroup Jy. 

a global Vogan packet 

= {tt^ = TTrj^ : TT^^ G H^^ and rj^ is trivial for almost all v}. 

V 

In particular, the representations in the global packet are indexed by irreducible 
characters 

V = ®vVv of JJ^</,„. 

V 

If TT^^ is a representation of G^^{Fy), then tt^ is a representation of the restricted 
direct product 

Note, however, that the group need not be the adelic group of a pure inner 
form of Go- For example, in the classical group case, need not be associated 
to a space V equipped with a relevant sesquilinear form over F. If G^ = 
G{V){A) for some space V over F, we shall call the representation rj coherent. 

for each tt^ e 11^, a non- negative integer 

rrir, = (A*(77),1)a^, 

where the expression on the right denotes the inner product of the two charac- 
ters of the finite group A^. Thus m,, is the multiplicity of the trivial character 
of A^, in the representation obtained by restriction of the tensor product of the 
representations rj^ to the diagonal. If rj is not coherent, then one can show that 
is equal to zero. When rj is coherent, so the adelic group G^ is defined over 
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F, the Langlands- Arthur conjecture for tempered representations predicts that 
rrijj is the muhiphcity of the representation tt^ in the discrete spectrum of 

With the above data, we have: 

(2) As G runs over all pure inner forms of Gq over F, there is an equivariant decom- 
position: 

0L5(G) = 0m,-vr,. 

G n 

We denote the representation in associated to the trivial character by ttq. It is 
a representation of Go (A) and is the unique representation in which is abstractly 
^-generic. According to the multiplicity formula in (v), its multiplicity in L^(Go) is 1, 
and the conjecture 124.21 then says that ttq has a nonzero ^-Fourier coefficient. 

Though the above conjecture of Langlands and Arthur is extremely elegant, it has a 
serious drawback: the group Li;' is not known to exist. However, in the case of the clas- 
sical groups considered in this paper, one can present the conjecture on multiplicities in 
a way that avoids mentioning the group Lp. We do this below. In the case of classical 
groups, there is a further simplification, as the component groups are all elemen- 
tary abelian 2-groups. In particular, the representations r]^ are all 1-dimensional, so 
their restricted tensor product t] also has dimension 1. Hence the predicted multiplic- 
ity rriri is either zero or one, the latter case occurring when rj has trivial restriction to 
the diagonal. In the general case, the groups A^f,^ can be non-abelian, and both the 
dimension of the representation t] and the dimension of its A^-invariants can be 
arbitrarily large. 

We now speciahze to the case where G = GiV) is a classical group. Let Gq = G(Vo) 
be the quasi-split inner form. Arguing exactly as we did in the local case, one sees that 
giving a global L-parameter for G 

is equivalent to giving a representation 

ip-.Lp — > GL(M) 

which is selfdual or conjugate-dual with a specific sign b. The requirement that (j) is 
discrete then translates to the requirement that as a representation of Lp, 

i 

where each Mj is selfdual or conjugate-dual with the same sign 6 as M and Mj ^ Mj 
if i ^ j. In this case, the global component group is the 2- group 

A^ = A^ = 1[{Z/2Z)m,, 
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with a natural basis indexed by the Mj's. 

Now to remove the mention of the hypothetical group Le-, observe that when spe- 
cialized to the case G = GL(l^), with dim\^ = n, the Langlands- Arthur conjecture 
simply says that there is a natural bijection 

{cuspidal representations of GL(\/)} 

{ irreducible ?7,-dimensional representations of Li?} . 

Thus, one may suppress the mention of L^? by replacing the latter set with the former. 
Hence, in the context of the classical groups G{V), one replaces the data of each Mj 
by a cuspidal representation vTj of GL„-(A£;), with = dimM,. Moreover, in view of 
Proposition 17.51 and its analog for symplectic and orthogonal groups, the selfduality or 
conjugate-duality of Mj with sign b can be described invariant theoretically and hence 
can be captured by the following L-function condition: 

(a) a cuspidal representation tt of GL„(A) is self dual of sign 

+ 1 if its symmetric square L-function L(s, vr, Sym^) has a pole at s = 1; 
— 1 if its exterior square L-function L^{s, it, A^) has a pole at s = 1. 

(b) a cuspidal representation n of GL„(A£;) is conjugate-dual of sign 

+1, if the Asai L-function L(s, vr. As) has a pole at s = 1; 
— 1, if the Asai L-function L(s, vr, As~) has a pole at s = 1. 

To summarize, a discrete global L-parameter ip for Gq = G{Vq) is the data of a 
number of cuspidal representations of GL„,-(A£;), with = dimVo, satisfying the 

above L-function conditions. The point of this reformulation is that given such a global 
L-parameter, one still has the data given in (i) -(v) above. More precisely, one has: 

(i) The global component group is simply the 2-group ]^^(Z/2Z)^. with a canon- 
ical basis indexed by the tTj's. 

(ii) For each v, the associated local L-parameter is the representation 

i 

of WD{ky), where is the local L-parameter of the local component vTj ,; 
of vTj. The L-function condition presumably forces each ipi^^ to be selfdual or 
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conjugate-dual with the given sign b. Moreover, one has a natural homomor- 
phism 

i 

arising from the natural map 

obtained by sending {%jT£)T^. to the central subgroup (±1) in the centralizer 
C^^^ ^ . Thus, one continues to have the diagonal map A. 

(iii) For each place the local parameter thus gives rise to a local Vogan packet 

as before. 

(iv) One can now define the global Vogan packet as before. 

(v) The formula for is as given before. 

The formulation of the Langlands-Arthur conjecture given above amounts to a de- 
scription of the discrete spectrum of classical groups in terms of the automorphic 
representations of GL„. The proof has been promised in a forthcoming book [A3]. 

In the remainder of this section, we formulate an extension of the Langlands-Arthur 
conjecture to the case of the metaplectic groups Sp(Vr). 

Motivated by Theorem lll.il one expects that discrete global L-parameters for Sp(W^) 
should be discrete global L-parameters for S0(2n + 1) with 2n = dimly. Thus, a 
discrete global L-parameter of Sp(iy) should be a multiplicity free 2n-dimensional 
symplectic representation of Lp: 

M = Mi®---®Mr 

with each irreducible summand Mj also symplectic. In the reformulation of L-parameters 
given above, it is thus given by the data of a collection of pairwise inequivalent cuspidal 
representations vTj of GL2ni (A) with 

(a) Ylii = n and 

(b) L(s, TTj, A^) having a pole at s = 1 for each i. 

Using Theorem 111.11 and Corollary 111.21 one sees that such a global L-parameter ip 
continues to give rise to the data (i) - (iv) above in the context of Sp(W^). In partic- 
ular, one obtains a global Vogan packet 11^ of irreducible genuine representations of 
Sp(W^)(A) with a bijection 

— Irr[n^^O- 
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However, the multiplicity formula given in (v) above needs to be modified. Moti- 
vated by results of Waldspurger in the case when dimVT = 2, we make the following 
conjecture. 

Conjecture 25.1. Let {(p,M) be a discrete global L-parameter for Sp{W) with asso- 
ciated global Vogan packet U,^. Let Xip be the character on the global component group 
defined by 

X^(a)=e(l/2,M'^). 

More concretely, if ai G is the basis element associated to the factor {Mi,TTi) in M, 
then Xip(ai) = eiji, 1/2). Then 

Lj(Sp(iy)) = 0m,7r, 
»? 

where 

We note that Arthur has also introduced nontrivial quadratic characters of the global 
component group A^ in his conjectures for the multiplicities of non-tempered repre- 
sentations of linear groups. 

We conclude this section with some ramifications of Conjecture l25.1[ Given a discrete 
global L-parameter {(p,M) (relative to a fixed additive character ip) for Sp(W^), with 
dim W = 2n, note that M is also a discrete global L-parameter for SO(y) with dim V = 
2n + 1. For each place v, the elements in the associated Vogan packets 

U^^iV) ofSO(r) 
U^M) oiSp{W) 

are both indexed by Irr(A^^). For a character rj^ of A^^, let 

7r^„ e U^^iV) and G n^„(iy) 

be the corresponding representations. By construction, vr^^ and o"^^ are local theta 
lifts (with respect to ip) of each other. One might expect that, globally, the submodule 
L^{Sp{W)) of the discrete spectrum can be obtained from 0^, L^{SO{V')) using global 
theta correspondence. As we explain below, this is not always the case. 

More precisely, if 77 = ®„?7^ is a character of Yl^ ; then the corresponding repre- 
sentations 

T^n G n^(V") and G Il^{W) 
may or may not be global theta lifts of each other. Indeed, 

Tirj occurs in the discrete spectrum of some SO(V') ^*(^) = 1 
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whereas 

an occurs in the discrete spectrum of Sp(11/^) <^=^ ^*{v) = Xf 

Thus, if Xip is non-trivial, then the subset of r/'s which indexes automorphic representa- 
tions for SO(y) will be disjoint from that which indexes automorphic representations 
of Sp(iy). In such cases, there is clearly no way of obtaining the automorphic elements 
in n<^(iy) from those of Il<p(y) via global theta correspondence (with respect to ip)- 

Suppose, on the other hand, that x-fi is the trivial character, so that 

e(M„l/2) = l 

for all the irreducible symplectic summands Mj of M. Then the automorphic elements 
in n^(iy) and H^iV) are indexed by the same subset of ?7's and are abstract theta 
lifts of each other. However, to construct L'^{Sp(W)) from L^(SO(V^)) via global theta 
correspondence, there is still an issue with the non- vanishing of global theta liftings. In 
this case, the non- vanishing of the global theta lifting is controlled by the non-vanishing 
of the central L- value 

L(M,l/2) = J]L(M,,1/2). 

i 

Only when L{M, 1/2) is nonzero does one know that L'^{Sp{W)) can be obtained from 
0y, L^(SO(K')) by global theta lifting (with respect to 

Another observation is that while the packet n<^(V^) always contains automorphic 
elements (for example the representation corresponding to = 1), it is possible that 
none of the elements in the packet 11(^(14^) are automorphic. 

We give two examples which illustrate Conjecture 125.11 and the phenomena noted 
above, in the case dimiy = 2. In this case, the conjecture is known by the work of 
Waldspurger [Wal, 2]. 

Example 1: Suppose that {ip, M) is a discrete global L-parameter for SO (3) = PGL(2) 
and Sp(2), so that 

= Z/2Z. 

Suppose that for 3 places vi, V2 and ^3, the local L-parameter (f^- corresponds to the 
Steinberg representation of PGL(2), and ify is unramified for all other v. Then 

e(M,l/2) = -l, 

so that Xip is the non-trivial character of A^p. 

In this case, the local Vogan packets (for both SO (3) and Sp(2)) have size 2 at the 
3 places f,, and we label the representations by 

n^„(SO(3)) = {7r+,7r,-} and (S^(2)) = K+, a^}. 
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with the minus sign indicating the non-trivial character of A^p^. At all other places, 
the local packets are singletons. Thus, the global L-packet of SO (3) has 8 elements, 
which we can label as 7r+++, 7r++^ and so on. Similarly, the global L-packet for Sp(2) 
also has 8 elements, denoted by cr+++, a^^ and so on. 

Now observe that a representation in the global Vogan packet for SO (3) is auto- 
morphic if and only if it has an even number of minus signs in its label, whereas a 
representation in the global Vogan packet for Sp(2) is automorphic if and only if it has 
an odd number of minus signs in its label. 

Example 2: Suppose again that {(p,M) is a discrete global parameter for S0(3) and 
Sp(2), but now assume that is reducible for all v. Moreover, suppose that 

e(M,l/2) = -l, 

so that x<fi is the non-trivial character of = Z/2Z. These conditions can be arranged. 

In this case, the global Vogan packets for SO (3) and Sp(2) are both singletons, 
containing the representation vr and a respectively, which are indexed by the trivial 
character t] of 

V 

Hence, A*{ri) is the trivial character of A^. In particular, vr is automorphic for S0(3), 
whereas a is not automorphic for Sp(2). 

26. Revisiting the global conjecture 

In this section, we shall revisit the global conjecture formulated in ^QM In particular, 
we shall approach the restriction problem using the framework of the Langlands- Arthur 
conjecture reviewed in ^ |25l 

We start with a quasi-split group Go over F associated to the pair of spaces Wq C 
Vo and fix an automorphic generic character 6 of U as in the previous section; in 
particular, 6 may depend on the choice of an appropriate additive character ip in various 
cases. Given a discrete global L-parameter (<^, M, A^) for Go, there is a corresponding 
submodule A"^ in the automorphic discrete spectrum and we are interested in the 
restriction of the linear functional -F(z^) to this submodule. 

Recall that a natural symplectic representation R of ^G plays a prominent role in 
the global conjecture 124. 1[ Using the global component group A^p of the parameter cp, 
we may refine the associated L-function L(7r, R, s) for vr G II;^, as follows. If a G A^, 
we may consider it as an element of A^^^ for any v and then choose any element in 
G(^^ projecting to it. Denoting any such element in G<^ C G by a again, we see that 
the subspace i?" is a submodule of WD{Fy) under ipy. Thus, one has the associated 
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L- function 



L(7r,i?",s) = J]L(i?»o<^„,s) 



V 



and epsilon factor 



V 



We are now ready to revisit the global restriction problem. Let us first draw some 
implications of the various local conjectures we have made so far. 

(i) According to our local conjectures 117.11 and 117.31 there is a unique representation 
7r„ in the local Vogan packet II;^^ such that 

HomH(F„)(vr^ (g) I^, C) 7^ 0, 

and this distinguished representation is indexed by a distinguished (relevant) character 

Xi, of Am, X A^^. 

For each w, the representation -n^^ is a representation of a pure inner form of Gq 
over F^, associated to a pair of spaces C 

(ii) According to our unramified local conjecture l21.3l for almost all f , the distinguished 
character is trivial and the representations vr^^, and z/„ are all unramified. At 
these places, the pair of spaces C K is simply W^^^ C Vo^t, and the group G„ is 
simply Go (-ft))- Thus, we can form the restricted direct product groups 



which are restricted tensor products, defined using the unique line of Jy-invariant or 
n ift,-invariant vectors for almost all v. The representation is simply the element 
in the global Vogan packet II,^ indexed by the distinguished character 

X = ®vXv 

of the compact group Am, x A]^^. It is the only (relevant) element in 11^ such that 

HomH(A)(vrx ® z^,C) ^ 0. 

With these preliminaries out of the way, there are now three questions to address. 
(1) Are i^A ^ Ga the adelic points of algebraic groups 




and representations 




H = N ■ G{W) ^G = G{V) X G{W) 
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defined over F, associated to a relevant pair of spaces W C V over E7 

In the symplectic case, this question clearly has a positive answer, since there is 
a unique symplectic vector space in any even dimension over any field. Hence, we 
focus on the other cases, where the issue is whether the collection {W^ C K) of local 
spaces is coherent in the terminology of Kudla. Now these local spaces have the same 
rank as Wq C Vq and the same discriminant in the orthogonal case. Hence, they 
form a coherent collection if and only if we have changed the Hasse-Witt invariant or 
the hermit ian/skew-hermitian discriminants at an even number of places v. This is 
equivalent to the identity 

{Yly e(Mu Ny, ijjy), in the orthogonal and hermitian cases; 
Yly Ny{fi~^), in the skew-hermitian case. 

Thus, we will have a global pair of spaces W G V with these localizations if and only 
if 

e(7ro,i?,l/2) = l. 
Assuming this is the case, the second question is: 

(2) Does the representation Hy. in the global Vogan packet Hj^ occur in the space Ao{G) 
of cusp forms? 

To answer this question, we exploit the Langlands-Arthur conjecture discussed in 
§25[ Thus, in the orthogonal, hermitian and skew-hermitian cases, we need to see if 
the distinguished character x is trivial when restricted to the global component group 
via the diagonal map A. This amounts to the assertion that, for all a G A^, 

{Ht, ^{{My A^„)", ipv), in the orthogonal or hermitian cases; 
e{My N^{fi~^)Y, ijj^), in the skew-hermitian case, 

or equivalently, that 

e(7ro, R", 1/2) = 1 for all a E A^. 

On the other hand, in the symplectic case, using the multiplicity formula given in 
Conjecture 125. we see that we need the distinguished character to be equal on A^ = 
Am X A'^ to the character Xo x 1 (assuming that M is symplectic and N orthogonal). 
This translates to the same condition 

1 = H e((M, ® N,r, ^,) = e(7ro, i^^ 1/2). 

V 

Finally, assuming that e(7ro,-R", 1/2) = 1 for all a G A^, so that tt^ occurs in the 
space of cusp forms, we can ask: 
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(3) Docs the linear form -F(z^) have nonzero restriction to vr^? 

The point is that, since the above conditions on epsilon factors are assumed to hold, 
there are no trivial reasons for the central critical L- value L(7ro, R, 1/2) to vanish. Here 
then is the second form of our global conjecture: 

Conjecture 26.1. Let tt^ be the representation in the global Vogan packet corre- 
sponding to the distinguished character x- Then the following are equivalent: 

(i) TT^ occurs in Aq{G) and the linear form F{u) is nonzero on 

(tt) L{7r^,R, 1/2)^0. 

27. The first derivative 

We maintain the notation and setup of the previous section, so that Wq C Vq is a 
pair of spaces over E with quasi-split group Gq = G{Vo) x G{Wo) over F. For a given 
discrete global L-parameter ((/?, M, N) of Go, we have a distinguished representation 

in the global Vogan packet U^, which is a representation of a restricted direct product 

Ga = Y\_ ^v{Fv) 

and is the unique element in the packet such that 

Homj^^(7r(2)I7,C) ^ 0. 

In this final section, we specialize to the orthogonal and hermitian cases (i.e. where 
and assume that 

e(7ro, R, 1/2) = -1 so that ^(vro, R, 1/2) = 0, 

where ttq is the generic automorphic representation of Gq{K) with parameter ip. In this 
case the group Ga does not arise from a pair of orthogonal or hermitian spaces W CV 
over E. In Kudla's terminology, the local data {Wy C K.) is incoherent. Nevertheless, 
we can formulate a global conjecture in this case, provided that the following condition 
holds: 

(*) There is a non-empty set S of places of F, containing all archimedean primes, 
such that the groups G,u{Fy) and Hy{Fy) are compact for all places v & S. 

This condition has the following implications: 

(i) dimW^Q-^ = 1. Indeed, this follows from the fact that = Ny.G(Wy) and a 
nontrivial unipotent subgroup Ny cannot be compact. Hence, for all places v, we 
have 

dim Vy — dim Wy + 1. 
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If we consider the orthogonal decomposition 

Vo = Wq®L 

over then since dV^ is relevant for all we have 



'v 



V 



Thus, though the collection (H^^ C K) is not coherent, the collection {W^^ is. 

(ii) Any archimedean place of F is real and the space must be definite. In the 
hermitian case, we must have E"^ = C. Hence, in the number field case, F is totally 
real and, in the hermitian case, E v& & CM field. Moreover, at all archimedean 
places V of F, the generic representation ttq,^ of Gq{F^ is in the discrete series, 
and TT^ is a finite dimensional representation of the compact group 



with a unique line fixed by H(Fy) = SO(n — 1) or U(n — 1). 

(iii) At finite primes v ^ S.we must have dim(\4/F^) < 4. Indeed, a quadratic form of 
rank > 5 over F^, represents 0. Hence, for function fields F, we have the following 
nontrivial cases: 



For simplicity, we will assume that F is a totally real number field and S consists 
only of the archimedean places. In the hermitian case, the quadratic extension E oi F 
is a CM field. 

Suppose first that the spaces Vy are orthogonal of dimension n > 3. Fix a real place 
a. If Va has signature (n, 0), let 



Since we have modified the Hasse-Witt invariant at a single place of F, and kept the 
discriminant of W*-^ ~ equal to the discriminant of La, there are unique global 
spaces 



Cy{Fy) = SO(n) X SO(n - 1) or U(n) x U(n - 1) 




,2) or (4,3) in the orthogonal case; 
, 1) in the unitary case. 




W C V over E 
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with localizations 

Wy C K for all V a, 
W: C at a. 

We note that we can make such a pair of global spaces for any place a oi F, having 

localizations C for all v ^ a, provided that dimW^„ ^ 3. When dirnVT^ = 2, we 
can make such a global space provided that Wa is not split over Fa, i.e. for all primes 
a which are ramified or inert in the splitting field E of the 2-dimensional space W^. 
The proof is similar to [Se, Prop 7] . 

We can use the global spaces C so constructed to define the groups 

ffa^Qa^ S0(\/") X SO(H/") 
over F. These have associated Shimura varieties 

over C, of dimensions n — 3 and 2n — 5 respectively, which arc defined over the rcfiex 
field E = F, embedded in C via the place a. The varieties over F are independent of 
the choice of the real place a, so we denote them simply by 

suppressing the mention of a. 

Next, suppose that the spaces K are hermitian over E^ of dimension n > 2. Fix a 
real place a and a complex embedding z : Ea ^ C If has signature (n, 0), let 

W* C V* 

be the unique hermitian spaces over E^ with signature 

(n-2,l)c(n-l,l). 

If Va has signature (0,n), let 

W* C V* 

be the unique hermitian spaces over Eq, with signatures 

(l,n-2)c(l,n-l). 

Again, since we have modified the hermitian discriminants at a single place a of F, 
and kept (W^)"*" — constant, there is a unique pair of global spaces 

W"^ C y° 

over E with localizations 

Wy C K, for aU V ^ a; 
W* C at a. 

Again, we can make such a modification at any place a of F which is not split in the 
quadratic extension E. 
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As before, we use the global spaces W" C V" to define groups 

over F. These have associated Shimura varieties 

S(G'") 

over C, of dimensions {n — 2) and (2n — 3) respectively, which are defined over the 
reflex fleld = E, embedded in C via the extension z of the place a. These varieties 
over E are independent of the choice of real place a of F, so we denote them simply 
by: 

We sketch the deflnition of the Shimura variety E of dimension n — 1 associated to 
incoherent hermitian data {W^} of dimension n which is definite at all real places v of 
F; the orthogonal case is similar. Take the modified space at a real place a, and 
let G — ResF/Q^{W"). We define a homomorphism 

v\oo 

as follows. Let (ei, • • • , e„) be an orthogonal basis of W*, such that the definite space 
Ci has the same sign as the definite space Wa- We set 

/z/z \ 

h{z) = ■■■ in \]{W:) 

V 'J 

and 

h{z) = 1 in all the other (compact) components j^U(W„). 

Let X be the GR-conjugacy class of h, which is isomorphic to the unit ball U„_i,i/U„_i x 
Ui in C"~^. The pair {G,X) satisfies the axioms for a Shimura variety [De3, §2.1]. 
The composite homomorphism 

w : fG„j)iR — ^ — > Gm 



is trivial, and the reflex fleld of = M{G, X) is equal to E, embedded in C via the 
homomorphism z extending a. Indeed, the miniscule co-character /x : {Gm)c Gc is 
defined over E: 

fa \ 
fj.{a) =1 . 1x1. 

The complex points of are: 

E(G,C) = G'(Q)\[XxG(Q)]. 
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Over E, the variety and its action of G{Q) = JJ^ U(FF^) depend only on the 

V finite 

incoherent family {VF^}. If 

is any finite dimensional representation of the compact group JJ^ U(W^), there is a 

V real 

local system T on E(G') over E associated to n^o- 

We now return to the study of the L-function L{t:q,R,s) at s = 1/2, using the 
arithmetic geometry of the cycle 

associated to the incoherent family {Wy C K)- The representation 

TToo = '^v realT^v of Y\_ Gy{Fy) 
V real 

gives a local system !F on S(G') which contains the trivial local system C when restricted 
to the cycle 

To get the appropriate representation tt/ = (8)^ finite t^i; of G{Q) on the Chow group of 
S(G) with coefficients in JF, we need to find this representation in the middle dimen- 
sional cohomology of S(G') with coefficients in (which is the "tangent space" of the 
Chow group). Hence we need 

Hom^(^)(7r^,i/'^(E(G),^))^0 

with d = dimE(G). We put 



n 



dimy", in the hermitian case; 
dimV^ — 1, in the orthogonal case, 



so that n > 2 in all cases. We have 

'dimS(G) = d = 2n-3 
dimS(iJ) =n-2 
codim = n — 1. 

Now Matsushima's formula for cohomology shows that 

dimHom^(^)(7r/,//''(E(G),^)) 
is equal to the sum of multiplicities in the cuspidal spectrum 

^m(7r" (0/3^areal7r/3) ^TT/) • {G{Ra) : ^(Ma)") 
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over the discrete series representations vr" of G(Mq,) with the same infinitesimal and 
central character as tTq,. If all of the multiplicities are 1, the middle co homology of 
S(G') with coefficients in T will contain the motive M ® N over F or E, associated to 
the parameter of the L-packet of ttq. 

On the other hand, the conjecture of Birch and Swinnerton-Dyer, as extended by 
Bloch and Beilinson, predicts that 

dim Hom^(Q) (vr; , Ci/"-i (S (G) , ^) ) 

is equal to the order of vanishing of the L-function 

L{-Kq,R,s) 

at the central critical point s = 1/2. If the first derivative is nonzero, we should have 
an embedding, unique up to scaling 

and the Chow group of codim(n — 1) cycles plays the role of the space of automorphic 
forms in ^ }26l 

The height pairing against the codimension (n — 1) cycle H{H), on which JF has a 
unique trivial system, should give a nonzero linear form 

F : CH'''\J:{G),J^) C 

analogous to the integration of automorphic forms over H{F)\H{A). This form is 
if(Q)-invariant, and our global conjecture in this setting is: 

Conjecture 27.1. The following are equivalent: 

(i) The representation Hf occurs in C W^^^ {J1{G) , J-') with multiplicity one and the 
linear form F is nonzero on ttj; 

(zz) L'{7To,RA/2)^0. 

Remark : Just as the cohomology of a pro-Shimura variety associated to a reductive 
group G over Q carries an admissible, automorphic action of G{Q), it is reasonable 
to expect that the Chow groups of cycles defined over the refiex field E will also 
be admissible and automorphic. We note that this is true for the Shimura curves 
associated to inner forms G of to GL2(Q): the action of G{Q) on the Chow group of 
zero cycles of degree is the Hecke action on the Mordell-Weil group of the Jacobian 
over Q, which factors through the action of endomorphisms on the differential forms. 
Here the multiplicity of a representation ttj of G{Q) on the Chow group in the tower 
is conjecturally equal to the order of zero of the standard L-function associated to tt/ 
at the central critical point. 
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As in the global conjecture in central value case, one expects a refinement of the 
above conjecture, in the form of an exact formula relating the pairing 

(S(/7)(7r^),S(/J)(7r;)) 

to the first derivative L'{ttq, R, 1/2). This would generalize the formula of Gross-Zagier 
[GZ], as completed by Yuan- Zhang-Zhang [YZZ], which is the case n = 2 where the 
codimension of the cycle is 1. Such a refined formula in higher dimensions has been 
proposed in a recent preprint of W. Zhang [Zh] . 
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